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for  conditions  that  limit  the  transferability  of 
models  and  contribute  to  the  credibility  problem. 

The  above  examinations  have  lead  to  a  proposed 
three-tier  hierarchy  of  documentation,  including  for 
the  analyst  documentation  that  is  presented  from  the 
context  of  discovery  rather  than  from  the  traditional 
context  of  justification.  Recommendations  are  made 
for  supplemental  studies  to  examine  related  issues. 
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ABSTRACT 


This  thesis  proposes  a  hierarchy  of  docuaentation 
for  coabat  aodals.  It  begins  by  axaaining  criticisas 
and  cradibility  of  coabat  aodals  to  establish 
underlying  causes  and  effects,  and  then  it  addresses 
aodel  proliferation  and  ever  increasing  coaplexity  as 
they  affect  ona's  ability  to  understand  and  transfer 
aodals.  A  aethodology  for  deter aining  whether  or  not 
a  aodel  is  applicable  to  a  specific  problea  is 
presented,  as  are  exaaples  of  potential  problea 
areas.  Currant  docuaentation  practices  are  exaained 
for  conditions  that  liait  the  transferabiLity  of 
aodel s  and  contribute  to  the  credibility  problea. 
The  aoove  exaainations  have  lead  to  a  proposed 
three-tier  hierarchy  of  docuaentation,  including  for 
the  analyst  docuaentation  that  is  presented  froa  the 
context  of  discovery  rather  than  froa  the  traditional 
context  of  justification.  Hecoaaendations  are  aade 
for  suppleaental  studies  to  exaaine  related  issues. 
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I.  fiA£JLS&2m  412  imgBiKIlgg 


A.  BACKGROOVD 


Sotivation  far  this  thesis  was  initially  provided  by 
Professor  Jaaes  G.  Taylor,  who  wanted  to  use  an  existing 
fully  operating  large-scale  coabat  aodel  as  a  teaching 
vehicle  in  a  coabat-aodell  ing  course  in  the  Operations 
Analysis  Curriculua  at  tha  naval  Postgraduate  School  (VPS) . 
The  original  plan  was  to  acquire  the  ATLAS  (A  Tactical, 
Logistical,  and  Air  Sisulation)  aodel  froa  the  3.  S.  Aray's 
Concepts  Analysis  Agency,  convert  it  for  use  on  the  VPS  IBB 
360  coaputer  and  develop  a  aanual  for  the  setup  and  running 
of  the  aodel  as  part  of  the  course.  Then  the  attrition  and 
aoveaent  routines  of  the  aodel  were  to  be  analyzed  as  a 
foraal  thesis. 

Tha  project  was  especially  appealing  to  the  author 
because  it  conforaed  with  a  fundaaeatal  belief  of  his,  that 
rather  than  developing  new  aodels  if  an  existing  aodel  is 
appropriate  for  a  given  analysis  it  should  be  acquired  and 
used.  The  concept  is  not  original  but  was  based  on 

recoaaendations  of  the  Aray  Bod  els  Review  Coaaittee.  [1] 
Acquisition  and  use  of  ATLAS  at  the  VPS  would  be  an 
application  of  tha  recoaaended  concept  of  transferring  an 
existing  aodel  whenever  its  use  is  feasible. 

In  late  Peb.  1979,  the  ATLAS  aodel  arrived  via  a 
aagnetic  tape,  and  the  author  proceeded  to  execute  the  above 
plan.  After  the  expenditure  of  about  four  aan-aonths  of 


effort  by  the  author  and  coaputac  ceatar  prognaaers  and  190 
ainutes  of  CPO  tiae,  ATLAS  was  successfully  coapllad  and 
linked.  This  axpanditura  of  affort  was  greatly  in  axcass 

of  the  axpactad  tiaa  to  coaplete  tha  task,  given  that  tha 
nodal  has  baan  in  axistanca  for  tan  or  aora  ytars  and  is 
considarad  to  ba  "sinple*  coaparad  with  othar  theatre-level 
aodals.  Shy  had  its  transfar  raguirad  such  axpanditura  of 
affort? 

In  raflacting  upon  tha  above  question,  tha  author 
raalizad  that  even  though  a  aodel  aay  have  been  used  for 
aany  years,  its  transfer  can  still  be  haapered  by  United 
docuaant ation.  This  thesis  will  relate  the  author's 
experience  with  ATLAS  ind  his  subsequent  investigation  of 
how  docuaentation  Units  the  transfar  of  existing  aodals 
between  agencies.  It  will  also  exaaine  tha  related 
problaas  of  aodel  coaplexity,  proliferation,  credibility, 
transparency,  and  transferability.  Based  on  this 
axaaination  and  tha  experiences  of  th9  author  luring  seven 
years  of  operation  research  related  assignaents,  a  new 
concapt  of  docuaentation  to  iaprove  tha  transferability  of 
coabat  aodals  is  proposal. 

B.  DEFINITIONS 


In  research  conducted  for  this  thesis  the  author 
discovered  that  in  aodaling  tha  saaa  word  can  have  aany 
connotations.  For  purposes  of  clarity  tha  author  adopted 
tha  definitions  of  aodaling  tarns  listed  in  tha  glossary  of 
Bef.  1.  This  does  not  iaply  that  they  are  tha  only  or  bast 
definitions,  they  are  only  used  as  a  point  of  departure. 

Within  tha  following  text  there  will  ba  references  to 
coabat  aodals,  theatre- level,  large-scale,  and  snail-scale 


aodels.  For  purposes  of  the  remarks,  discussions,  and 
recoaaendations  contained  herein,  the  words  can  be 
considered  synonymous.  Since  the  initial  iapetus  for  the 
thesis  concerned  work  with  a  theatre-level  aodel  this  ters 
readily  crept  into  the  author's  dicussion.  However,  all 
these  forms  of  aodels  are  just  subsets  of  the  concept  of  a 
coaoat  aodel.  what  is  addressed  throughout  the  thesis  is 
coabat  modeling.  Particular  ccaaents  referring  to  one  of 
the  subsets  are  just  as  applicable  to  coabat  models  as  a 
whole. 

Although  some  reaarks  are  addressed  to  the  DDD ,  others 
to  the  Departaent  of  the  Army,  each  is  applicable  to  the 
other  as  wall  as  the  other  services.  The  discussions, 

conclusions,  and  recoaaendations  are  equally  applicable  to 
other  coaplex  aodels  as  well  as  aodels  in  general. 


C.  MODELING  A  WO  HODELS 


What  is  aodeling?  According  to  Morris  (2]  aodeling  is 
an  intuitive  process  through  which  an  analyst  arrives  at  a 
aodel.  On  the  other  hand,  a  aodel  is  an  inaniaate  object, 
an  abstraction  of  reality  [3],  that  is  used  by  the  analyst 
to  answer  questions  about  soae  future  state  of  a  process. 
This  differentiation  between  aodeling  and  a  aodel  is 
necessary  to  understand  the  iaplications  of  the  facts 
presented  and  the  conclusions  drawn  in  this  thesis. 

To  develop  a  aodel,  the  modeler  goes  through  a  process 
of  discoveryt  .  This  process  is  the  trial  and  error  procedure 
in  which  the  designer  tries  to  abstract  the  key  aleaents  of 
reality.  Once  he  has  dona  this  and  validated  his  aodel,  the 
logical  reconstruction  of  events  leading  to  the  aodel  are 
documented  in  the  context  of  justification.  This  logical 


reconstruction  has  little  if  anything  to  do  with  the  actual 
process  followed  in  building  the  eodel.  No  atteept  is  aade 
to  verbalize  the  actual  psychological  process,  the  problees 
encountered,  or  dead  ends  pursued. 

Over  tise  the  initial  siaple  aodel  proceeds  through  a 
process  of  enrichaent  or  elaboration.  Through  this  process 
the  eodel  is  eodified  and  aoved  in  evolutionary  fashion 
toward  a  aore  elaborate  representation  of  reality;  in  the 
process  the  aodel  becoaes  aore  coaplex  as  it  seeks  to 
reflect  the  coaplexity  of  the  reality  it  represents.  Each 
tiae  the  aodel  is  enriched  the  reasons  why  and  how  it  is 
enriched  should  be  docuaeated.  For  a  discussion  of  the 
aodeling  process  see  Ref.  2. 


0.  INTaOOaCTION 


Since  ancient  tiaes  ailitary  planners  have  used  vargaaes 
to  investigate  various  aspects  cf  possible  future  ailitary 
operations.  Historical  developaent  of  war  gases  can  be 
found  in  Bef.  4  or  other  histories  of  war  gaaes  in  the  open 
literature.  The  oldest  known  fora  of  the  wargaae  is  a 
Hindu  chess-like  gaae  called  "Chaturanga**.  Modern  war 
gaaes  had  their  beginning  in  1664  thru  the  gaaes  developed 
by  Christopher  Nerkaann  called  ailitary  chess.  In  the 
twentieth  century  the  greatest  proponent  of  war  gaaes  till 
the  end  of  NBII  was  the  Geraan  Aray.  Through  the 
developaent  of  the  digital  coaputer  luring  the  war  a  new 
facet  of  wargaaing  bee as*  possible.  The  use  of  the  coaputer 
greatly  reduced  the  tiae  and  effort  required  to  conduct  a 
war  gaae.  Coaputer  assisted  or  coaputer  run  war  gaaes 
provide  a  aeans  of  gaining  insights  and  experience  in 
ailitary  problea  solutions.  [5]  These  coaputer  war  gaaes 
help  evaluate  new  weapons  systess,  study  current  and 
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proposed  silitary  organizations  and  investigate  the  possible 
outcomes  of  future  conflicts  given  particular  weapons, 
organizations,  tactics,  and  eneay  forces.  The  basis  of  such 
cosputer  wargaaes  is  the  coabat  aodel.  Although  there  are 
aany  ailitary  applications  of  coabat  aodels,  this  thesis  is 
priaarily  concerned  with  those  applicable  to  ailitary 
strategy  and  force  planning. 

Military  strategy  and  force  planning  has  aatured  since 
UHII.  Prior  to  dill  ailitary  technology  evolved  slowly; 
those  responsible  for  strategy  and  planning  could  easily 
gain  all  the  necessary  knowledge  about  the  relationship  of 
ailitary  forces  and  weapon  sv3teas  to  national  security  froa 
boots  or  personal  experience.  within  one  lifetiae  the 
aaount  of  technological  change  was  not  sufficient  to  render 
experience  invalid.  The  ailitary  did  not  plan  on 
technological  chaoge;  it  aerely  adjusted  to  it. 

during  and  subsequent  to  WWII,  the  rate  of  change  of 
ailitary  technology  began  to  increase  in  an  alaost 
exponential  aanner.  A  lifetiae  of  experience  could  becaae 
obsolete  in  a  few  years;  now  sere  adju3t»ent  to  change  was 
not  sufficient,  the  ailitary  had  to  plan  for  change.  This 
revolution  in  technology  was  incubated  and  nurtured  by  the 
advent  of  the  digital  coaputer:  to  keep  pace  with 
technology  and  its  iapact  on  strategy  and  force  planning  the 
digital  coaputer  was  adopted  as  a  planning  tool.  With  it 
the  aeans  to  assess  and  adapt  technological  change  and 
incorporate  it  into  ailitary  strategy  and  force  planning  was 
possible .  C  6  1 

flodern  day  force  planning  has  becoae  largely  an 
analytical  process  that  necessarily  eaploys  the  digital 
coaputer.  The  digital  coaputer  has  been  incorporated  into 
aany  of  the  ayriad  aspects  of  ailitary  planning  and  decision 
aaking  in  order  to  provide  a  scientific  basis  to  these 


activities.  In  this  thesis,  the  computer  is  considered  only 
as  a  coaputational  aid  £or  coabat  aodels.  The  outputs  of 
these  aodels  are  used  as  aids  to  decision  Bakers.  Strategy 
and  force  planning  depend  priaarily  on  large-scale  coabat 
aodels,  which  due  to  their  coaplezity  reguire  the  use  of 
digital  coaputers.  aodals  can  oe  of  various  types  or 
classes;  there  is  no  agreed  upon  systea  of 
classification.  Discussions  of  classification  of  coabat 
aodels  are  contained  in  the  literature.  (3,7  8]  This  study 
is  concerned  with  large  scale  coaputer  siaulations  and 
analytical  aodels  as  defined  in  Ref.  3. 


2.  SUBS  ART 


This  chapter  has  discussed  tne  background  of  this 
thesis,  and  it  has  provided  soae  basic  definitions  and  a 
general  history  of  coabat  aodeling  to  the 
present.  Subsequent  chapters  will  now  address  the  following 
iaportant  aspects  of  aodels  used  for  defense  planning: 
criticise  and  credibility;  proliferation,  coaplezity  and 
transparency,  and  requireaents  to  transfer  a  aodel.  Nezt 
a  coaaon  eleaent  of  each  chapter,  lack  of  adequate 
docuaentation,  is  identified  as  a  contributing  cause  to  each 
of  the  conditions  discussed.  This  is  followed  by  a 

proposed  concept  of  docuaentation  that  will  alleviate  aany 
of  the  probleas  discussed  in  this  thesis. 
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A.  CAUSES  OP  CBITXCISH 

Celtics  sod  criticisa  of  defense  analysis  and  its  tools, 
of  which  aodeling  is  just  one,  are  ever  present.  Criticise 
has  not  abated  since  the  early  sixties;  it  continues  to  the 
present  and  threatens  funding,  the  life  blood  of  analysis, 
in  the  Departaent  of  Defense.  Inforaed  private  citizens  and 
activitists  groups  have  attacked  the  propriety  of  defense 
analysis  and  DOD  decisions  based  on  analysis.  The  poor 
public  laage  was  cited  as  a  contributing  factor  to  the  poor 
reception  of  analysis  in  Congress.  Because  of  seeaing 
inconsistencies  in  analysis.  Congress  has  becoae  skeptical 
and  disenchanted  and  has  questioned  the  utility  of 
analysis  .  ( 9  ] 

According  to  surveys  and  studies  conducted  early  in  this 
decade  (19]  activity  ind  expenditures  on  gating  and 
siaulation  peaked  in  the  aiddle  1960's  and  were  on  a  slight 
decline  since  then.  These  investigations  indicated  that 
sachine  siaulation  had  generally  been  oversold  and  at  that 
tine  Operations  Basearch  and  aodeling  were  undergoing  a 
critical  self-exaaination.  (11]  The  criticisas  were  aany 
and  encoapassed  a  wide  variety  of  cause  and  effect 
relationships.  Those  of  relevance  to  this  study  revolve 
about  the  inter-related  areas  of  transferability, 

coaplexity,  proliferation  and  docuaentation. 
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As  tbs  ass  of  combat  sodsls  increased,  so  did  their 
initial  acceptance  and  importance,  and  in  tarn  the 
complexity  of  these  sodels  has  also  increased.  Coeplezitf 
has  sanifested  itself  in  various  fores:  inputs,  types  of 
eodels,  language,  detail  of  actions  and  conditions 
sinulated,  siaulated  decision  Baking  and  conputing 
machines.  Eventually  the  complexity  of  existing  models, 
poor  transparency ,  and  difficulty  of  transferability  caused 
numerous  models  to  be  developed  that  modeled  the  same  or 
very  similar  cosbat  phenonema.  Qnf  ortanately,  at  this 

juncture  in  the  development  of  combat  models  (late  60's, 
early  70's)  criticism  and  dwindling  credibility  occurred. 
Ihis  came  about  because  for  reasons  not  easily  recognizable 
or  understandable  to  decision  makers,  models  supposedly 
modeling  the  same  combat  process  under  the  "saae"  conditions 
produced  different  and  at  time  conflicting  results. 

Analysis  implies  rigor  and  association  with  the 

scientific  method,  yet  standards  seemed  to  have  waned; 
strict  adherence  to  standards  of  scientific  rigor  and 

discipline  were  less  than  tenacious.  Often  analyses  and 
models  produced  had  methodological  flaws.  Often  these  flaws 
were  not  discovered  until  after  an  analysis  had  been 

accepted  and  decisions  made.  In  studies  involving  models, 
one  of  the  contributing  factors  to  this  situation  was  lack 
of  detailed  understanding  of  the  model.  Other  contributing 
factors  were  the  pressure  of  time  and  limited 
distribution.  In  the  rush  to  meet  deadline  the  quality  of 
the  work  was  often  sacrificed.  By  not  distributing  a  study 
or  model  to  other  agendas  the  extra  set  of  eyes  that  can 
see  a  fatal  flaw  through  an  unbiased  viev  were  never  used. 

The  use  of  more  than  one  model  has  often  resulted  in 
decision  makers  being  confronted  by  seemingly  contradictory 
results  of  different  analyses  using  different  models 


la 


addressing  the  saae  problea.  Ho  wonder  that  they  have  the 
iapression  that  the  aodels  and  aethods  used  by  analysts  say 
not  be  very  objective  guides.  Tet  aost  analysts  will  argue 
that  a  detailed  coaparison  of  aodels,  their  assuaptions, 
inputs  and  calculations,  show  that  the  results  are  not 
really  contradictory.  Differences  in  outputs  are  usually 

e 

the  direct  result  of  differences  in  assuaptions  and  aethods 
of  processing  the  input  lata.  This  in  turn  presents  the 
analyst  with  two  challenges:  First,  he  sust  recognize  and 
understand  these  seeaing  contradictions,  and  then  he  Bust 
resolve  and  convey  to  the  decision  aaker  these 
differences.  Dr.  Hilbur  3.  Payne,  foraer  Deputy 
Undersecretary  of  the  fcray  for  Operations  Research  speaking 
froa  the  point  of  view  of  the  decision  eater  who  tries  to 
draw  valid  conclusions  froa  analyses  that  use  such  aodels, 
has  argued  that  he  has  frequently  seen  such  apparently 
contradictory  results  cosing  froa  various  aodels  addressing 
essentially  the  saae  problea.  Furtheraore,  the  decision 
aaking  process  in  large  organizations  is  such  that  the 
detailed  coaparison  ,  if  it  is  ever  done  ,  and  resolution  of 
seeaing  conflicts  usually  does  not  reach  the  decision 
aaker.  Hence,  the  decision  aaker  is  left  with  the 
conclusion  that  siaulation  results  are  not  consistent  and 
therefore  of  dubious  reliability.  [ 12] 

Contradictory  results  of  coabat  aodels  is  a  factor  cited 
by  Huber  [12]  that  has  caused  the  very  credibility  of  coabat 
sodeling  to  be  guestionad.  Under  ideal  conditions  a  aodel 
should  be  directly  connected  with  a  continuing  experiaental 
prograa  and  should  reasonably  relate  to  other  aodels  that 
siaulate  the  saae  or  siailar  processes.  The  user  a ust  be 
especially  watchful  in  this  respect  because  the  coabat 
process  does  not  easily  lend  itself  to  establishing  a 
continuing  experiaental  prograa.  Hany  coabat  aodels  are 
neither  built  nor  used  with  any  forethought  given  to  their 
connection  to  other  aodels.  Bach  generally  turns  out  to  be 
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a  totally  independent  data  generator.  This  precludes  any 
aeaningful  experiaental  feedback  in  the  on-going  prediction 
process  and  rasults  in  a  aass  of  unrelated  and  oftan 
contradictory  data  ganaratad  by  aany  aodals. 

Tha  Any  Hodels  Review  Coaaittaa  report  was  tha  sasinal 
publication  on  theatre-level  coabat  aodals  for  tha 
seventies.  Proa  it  sprang  a  decade  of  proposals  ind  counter 
proposals  concerning  thaatre-laval  coabat  aodals.  However, 
if  one  scrutenizas  the  literature  of  the  previous  decade  a 
feeling  of  deja  vu  surfaces.  Many  of  the  ideas  and 
arguaents  sounded  in  the  seventies  are  in  the  literature  of 
the  sixties.  for  an  exaaple  of  the  probleas  foreseen  and 
warnings  given,  see  Ref.  13. 


3.  IHPORTAMCZ  OP  ASSOHPTIOHS 


One  of  the  key  facets  of  any  aodel  is  the  assuaptions 
that  go  into  its  developaent.  The  iaportance  of 
assuaptions  whether  in  aodels  or  otherwise  was  recognized 
early  in  the  developaent  of  systeas  analysis.  dhen  He 
laaara  was  Secretary  of  Defense,  a  continuing  effort  was 
aade  to  insure  assuaptions  incorporated  into  aodels  were 
both  explicit  and  consistent.  Bhether  coaparing  force 
structure  or  strategy.  He  Naaara  considered  it  possible  to 
select  assuaptions  that  will  Bake  any  proposed  weapon  systea 
or  organization  look  optiaal.  [6]  Likewise,  experience  has 
shown  that  thare  is  no  single  "right1*  set  of 
assuaptions.  There  exists  an  alaost  infinite  set  of 
assuaptions  each  a or a  or  lesa  defensible.  Hhat  is  i a portent 
is  that  the  assuaptions  used  in  various  subaodels  of  a  aodel 
are  consistent.  A  aodel  should  not  operate  with  one  set  of 
underlying  assuaptions  in  one  subaodel,  while  another 
subaodel  operates  with  a  fundaaentally  different  set. 
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rhe  OOD  is  quite  snare  of  this  aspect  of  aodeling  aad 
has  eaphasized  that  there  is  sore  than  one  set  of 
assuaptions  that  can  be  used  with  a  given  aodel.  It 

requires  that  all  parties  to  the  decision  ashing  process  be 
aware  of  all  assuaptions  leading  to  a  result.  To  achieve 
this  goal  the  000  has  required  that  all  assuaptions  be 
explicit,  reasonable,  and  consistent.  This  requires 
ferreting  out  hidden  assuaptions  in  aodels  and  insuring  that 
the  aodel  indeed  aodels  what  it  claias  to  aodel.  For 
interesting  exaaples  of  the  iaportance  of  assuaptions  see 
Bef.  6. 


C.  90DEL  SVALOAriON 


Sany  solutions  to  the  problea  of  aodel  evaluation  have 
been  recoaaended;  one  concept  suggests  the  use  of  full  tiae 
dedicated  independent  reviewers  as  a  way  of  iaproving  the 
aechanics  of  quality  control.  [1]  A  reviewer  provides  a 
aeans  through  which  the  analyst's  aodel  is  scrutinized;  the 
assuaptions  and  aethodology  are  checked  for  internal 
consistency,  unwarranted  inferences,  and  clarity  of 
presentation  so  that  a  deteraination  can  be  aade  whether  or 
not  the  aodel  is  a  plausible  representation  of  the  real 
world.  If  it  is  a  large  coaplex  aodel,  the  aethodology 
should  be  clear,  aven  to  the  point  of  saaple  calculations  to 
guide  the  reviewer  and  analyst  through  the  llgorithas. 
Equally  iaportant  is  that  input  data  and  assuaptions  be 
explicit.  If  unnecessary  proliferation  is  to  be  avoided, 
existing  aodels  aust  be  aade  understandable  to  potential 
users  aad  evaluated  in  soae  Banner.  It  should  not  be 
necessary  to  create  a  new  aodel  just  because  an  existing 
aodel  could  not  be  transferred  or  understood  due  to 
inedquate  docuaentatioa. 
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In  his  study,  Gass  [  1 '■»  ]  proposes  an  elaborate  approach 
to  evaluation  of  cosplez  aodels.  Therein  he  highlights  the 
need  for  sodel  isplesentation  and  saintenance  procedures  as 
veil  as  docusentation  of  the  sodel  and  the  total  nodeling 
process.  Suggested  docusentation  of  the  process  includes 
describing  sodel  objectives,  assumption s,  results,  data 
sources,  recossendations,  etc.  Kith  such  docusentation  the 
sodel  can  hopefully  be  evaluated  and  analysts  can  detersine 
whether  or  not  the  aodel  is  valid  for  the  problen  at 
hand.  However,  Gass  found  that  for  aost  coaplex  cosputer 
aodels,  organizational  exigencies  and  real-world  pressures 
do  not  enable  aodelers  to  develop  the  necessary 
docuaentation. 

Gass  has  stressed  the  need  to  validate  aodels  at  three 
distinct  levels,  technical,  operational,  and 

dynaaic.  Technical  validity  is  an  assessaent  of  aodel, 
data,  logical,  mathematical  and  predictive 

validity.  Operational  validity  is  an  assessaent  of  errors 
and  divergences  found  under  technical  validity  and  the 
robustness  of  the  aodel  (i.e.  whether  or  not  the  aodel  can 
produce  bad  answers  for  proper  ranges  of  paraaeter  values) . 
Dynaaic  validity  is  the  sethod  by  which  the  aodel  will  be 
aaintained  during  its  life  cycle  so  that  it  continues  to  be 
an  acceptable  representation  of  the  real  systes.  It 
includes  the  process  through  which  the  aodel  structure  is 
changed  and  validated.  The  ability  to  accoaplish  such 
validation  will  facilitate  and  enhance  the  use  of  aodels  by 
anaylsts  and  decision  aakers  other  than  those  directly 
responsible  for  the  develops ent  of  the  aodel.  Pundanental 
to  this  process  is  detailed  understanding  of  the  aodel. 
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D.  SOBBARX 


If  a  aodel  is  to  be  of  value  it  aust  b«  accepted  by  the 
decision  aaker.  It  is  incuabent  upon  tba  analyst  to  provide 
the  aaans  of  accaptanca.  Sufficient  docuaentation  aust  be 
provided  by  the  aodal  designer  to  enable  the  analyst  to 
understand  its  aethodology  and  structure.  Kay  to 
credibility  is  objective  evaluation.  Docuaentation  aust 
provide  insights  into  the  assuaptions  and  functioning  of  a 
aodel,  so  that  it  can  be  evaluated.  Understanding  and 
evaluation  are  coaplicated  by  coaplexity.  Coaplexity  and 
insufficient  docuaentation  can  cause  analysts  to  design  new 
aodels  rather  than  use  an  existing  aodel.  The  existence  of 
inadequately  docuaented  aodels  describing  the  sane  reality 
is  the  basic  cause  of  the  criticise  and  lack  of  credibility 
of  coaoat  aodels.  The  next  chapter  will  discuss  coaplexity 
and  how  and  vhy  it  contributes  to  unnecessary  proliferation. 
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III.  Eg  3  LITER!  II  3jj «.  £OflEle£UIIx  Ufi  mUSUUISI 


Unnecessay  proliferation  is  the  cause  of  soee  of  the 
criticises  of  coebat  aodeling.  Unnecessary  proliferation 
eeans  that  a  new  aodel  is  created  because  inadequate 
docuaentation  precludes  the  use  of  an  existing  aodel  which 
otherwise  wouli  be  adequate  for  the  task  at 
hand.  Inadequate  docuaentation  either  prevents 
understanding  of  the  aethodology  and  structure  of  the  aodel 
or  prevents  the  cost-effective  transfer  and  conversion  of 
the  aodel  froa  one  agency  and  coaputing  systee  to 
another.  The  latter  condition  is  the  one  encountered  by  the 
author  during  the  conversion  of  ATLAS.  Better  docuaentation 
would  have  significantly  reduced  the  resources  expended  on 
the  project.  Futheraore,  in  a  non-acadeaic  environaent  the 
deaands  of  proceeding  with  an  iapending  study  would  have 
encouraged  analysts  to  develop  a  new  aodel  rather  than 
struggle  with  poor  or  non-existing  docuaentation. 

Developaent  of  a  new  aodel  can  cause  analysts  to  reaodel 
a  coebat  process  using  techniques  and  aethodology  that 
already  exists;  consequently  funds  are  expended  without 
advancing  aodeling.  Irrespective  of  any  advanceaents  in 
techniques  or  iaproveaents  in  aethodology  developed  in 
reaodeling  an  existing  process,  a  aajor  portion  of  the 
effort  is  devoted  to  redoing  the  basics.  Tiae  and  aoney 
spent  in  redoing  the  basics  are  lost  as  far  as  isproving 
aodels  and  aodeling  is  concerned.  In  the  DOD  (especially 
the  Departaent  of  the  Aray)  there  has  been  and  continues  to 
be  a  shortage  of  trained  analysts.  An  obvious  approach  to 
alleviate  this  probles  would  be  to  eliainate  any  projects  to 
develop  aodels  that  would  be  redundant  and  share  existing 
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aodels.  However,  the  ability  to  share  a  eodel  is  greatly 
influenced  by  its  coaplexity. 


When  exaaining  the  practicality  and  feasibility  of  aodel 
sharing  aost  eaphisis  has  been  placed  on 
docuaentation.  Huber  [8]  lists  poor  docuaentation  and  high 
personnel  turnover  as  a  priae  reasons  why  aodels  are  not 
exchanged.  The  criterion  used  to  deteraine  whether  or  not  a 
aodel  is  transferable  is  docuaentation  sufficient  to  allow 
the  recipient  organization  to  be  able  to  run  the  aodel 
without  an  inordinate  aaount  of  decoding  and 
deciphering.  Without  adequate  docuaentation  the  aodel  is  a 
puzzle  to  the  recipient.  Shubick  and  Brewer  [10]  found  that 
few  aodels  exist  in  a  sufficiently  docuaented  fora  that 
would  satisfy  coaaercial  firs  standards  prior  to 
distribution  to  their  clientle. 


4.  PBOLIPSR ATIOW  AND  HOW  TO  REDOCS  IT 


An  area  exaained  by  the  CoaptrOller  General  in  1974, 
[15]  was  sharing  of  coaputerized  aodels.  Hodels  developed 
for  specific  purposes  by  one  agency  can  often  be  used  by 
other  agencies  for  siaiiar  purposes.  Applicability  of 
aodels  to  new  situations  depends  on  their  accuracy,  purpose, 
validity,  availability  of  sufficient  docuaentation,  and 
capability  of  the  using  analyst.  The  1974  study  surveyed 
242  aodels  that  had  a  coabined  cost  of  over  thirteen  aillion 
dollars.  An  atteapt  was  then  aade  to  obtain  docuaentation 
for  about  one  hundred  randoaly  selected  aodels  deeaed  to 
have  use  at  sore  than  the  originating  agency.  Inforaation 
explaining  the  purpose,  aatheaaticil  foraulation,  and 
operating  instructions  ware  not  available  for  approxiaately 
one-third  of  the  aodels.  The  survey  identified  the 
priaary  coaplaints  of  aodel  users  (prograaaers  and  analysts) 
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as:  operating  instructions  not  available  or  aot  clear, 
hence,  compounding  the  already  difficult  problee  of 
preparing  a  aodel  for  use  on  a  different  conputer; 
aatheaatics  of  the  aodel  not  clearly  explained,  hence, 
restricting  the  understanding  of  the  logic,  capabilities  and 
liaitations  of  the  aodel;  saapla  inputs  and  outputs 
nonaatching  or  nonexistent  or  do  not  correspond  with  the 
sasple  data  in  docuaentation,  hence,  verification  and 
validity  of  the  aodel  difficult  to  detersine;  flow  chart 
explaining  logic  not  provided  or  not  current,  hence,  coaplex 
subroutines  not  easily  understood.  The  investigation 

deterained  that  benefits  can  be  obtained  by  sharing  coaputer 
aodels,  however,  before  models  can  oe  shared  adequate 
docuaentation  must  be  prepared.  Such  documentation  enabled 
the  acquiring  agency  to  determine  whether  a  aodel  set  its 
needs  and  was  the  priaary  factor  to  successful  conversion 
and  operation  of  the  aodel  on  a  different  coaputer.  The 
potential  for  a  cost-effective  transfer  is  severely  liaited 
in  the  aosence  of  adequate  docuaentation.  When  such 

docuaentation  is  available  to  potential  users  of  an  existing 
aodel  great  savings  are  realized.  In  exaapla  was  the 
transfer  of  a  coaplex  communications  traffic  analysis  aodel 
froa  an  Air  Force  agency  on  the  Vest  Coast  to  the  Systems 
Development  Conaand  at  Hanscoa  Air  Field  in  Bedford, 
Sassachusetts.  [15] 

Joint  usage  of  existing  models  not  only  increases  the 
availability  of  trained  individuals  to  do  further  research 
and  analysis,  but  it  reduces  the  opportunity  that  different 
factions  of  the  sase  organization  are  working  at  cross 
purposes.  Conflicting  concepts  and  proposals  are  necessary 
to  vitalize  an  organization  and  sake  it  vlible,  but 
developing  a  conflicting  position  that  could  be  resolved 
prior  to  the  expenditure  of  great  suss  of  aoney  and 
analytical  talent  is  a  waste.  The  sharing  of  a  aodel  or 
aodels  between  two  conflicting  agencies  allows  each  to 


understand  the  underlying  basis  for  their  respective 
positions  concerning  an  analysis  of  a  decision  salting 
situation.  Bhile  sharing  say  not  resolve  the  conflict  it 
certainly  will  preclude  the  expenditure  of  funds  in  the 
independent  acquisition  of  inforaation  that  is  already 
available  through  the  aedius  of  ar.  existing  aodel.  Sharing 
has  eliainated  retracing  steps  already  taken  and  dead  ends 
already  discovered  when  applied  in  other  fields  ,  applied  to 
coabat  aodeling  sharing  will  provide  these  ainiaal  returns 
and  has  the  prospective  of  providing  even  greater 
returns.  If  the  basics  are  not  reprocessed  then  aore  tiae 
and  aoney  is  available  for  aodif ications  to  enhance  the 
capability  of  an  existing  aodel.  correct  known  deficiencies, 
or  identify  suspected  deficiencies.  Sharing  has  proaise  to 
iaprove  the  econoaies  of  aodeling.  [16] 

Before  sharing  can  be  achieved  certain  basic  conditiions 
aust  prevail.  Pive  necessary  conditions  [17]  to  aodel 

sharing  have  been  found.  They  are; 

(1)  a  coaputer  able  to  use  the  prograa  with  ainiaal 
aodif ica tion ; 

(2)  an  adequate  facility  to  run  the  aodel; 

(3)  adequate  docuaentat ion  of  the  original  aodel; 

(4)  sufficient  analysts  with  technical  coapetence; 

(5)  foraalizad  arrangeaents  for  sharing  costs  and 
responsibility  for  costs  and  coordination. 
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B.  THE  EFFECTS  OF  CONPL3 X ITT  OH  TRANSPARENCY 


Coaplexity  is  a  dichotoaous  issue  in  it3elf.  Gass 
perceives  an  increasing  use  of  sore  coeplex  aodels  [in], 
while  Hardison,  tne  Deputy  Under  Secretary  of  the  Arey  for 
Operations  Research  at  the  15th  Annual  US  Aray  Operation 
Research  Syaposiua  called  for  less  coaplexity. 
Disatisfaction  of  both  senior  ailitary  and  civilian  decision 
lakers  with  coaplex  aodels  and  studies  was  eaphasized  by 
Hardison.  [Id]  These  decision  makers  are  convinced  that 
Aray  aodels  and  the  studies  they  support  are  too  coaplex, 
elaoorate  the  obvious,  belabor  needless  details  and  overlook 
key  issues.  Tiaeliness  is  also  affected  by 

coaplexity.  Pailure  to  deliait  results  in  failure  to  aeet 
schedules  which  causes  soaething  to  be  sacrificed;  often,  in 
the  case  of  aodels  that  soaething  is  adeguate 

docuaentation. 

A  corollary  of  the  coaplexity  issue  is  that  of 

transparency.  If  all  the  interactions  of  a  aodel  are  to  be 

understood  by  both  the  analyst  and  the  decision  aaker  it 
aust  be  structured  and  prograaaed  so  that  its  aethodology  is 
easily  understood.  A  aodel  that  fulfills  this  reguireaent 
is  said  to  be  transparent.  At  the  35th  Session  of  HORS  a 
leading  cause  of  the  general  disenchantaent  with 
theatre* level  aodels  in  recent  years  was  attributed  to  a 
lack  of  transparency  in  aost  aodels.  The  proposed 

resolution  to  this  problea  was  to  include  in  the  aodel  only 
those  interactions  and  factors  that  can  be  shown  to 

influence  the  outcoae.  This  in  coabination  with 

aatheaatical  formulation  that  is  as  siaple  as  possible 

should  produce  the  desired  transparency.  [19]  Yet,  at  this 
saae  HORS  session  A . H.  Cordesaan  OASD  (Intelligence)  in 
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discussing  theatre- le vel  aodels  remarked  thit  aodels 
currently  being  developed  go  into  unnecessary  levels  of 
detail  in  ways  which  seriously  liait  their  value.  This  is 
partially  caused  by  interaediate  aanagers  and  decision 
Bakers  revesting  particular  attributes  be  aodeled.  At 
tiaes  aodeling  efforts  deviate  froa  the  aazia  that  only 
"essential"  variables  be  aodeled.  As  Sorris  [2]  suggests, 
the  purpose  of  a  aodel  is  to  include  only  those  variables 
that  characterize  the  process  being  aodeled.  At  present 
diaaetrically  opposed  forces  exist;  while  expounding  the 
need  to  aaintain  aodels  at  a  siaple  transparent  level 
current  aodeling  efforts  go  into  details  that  detract  froa 
transpar  ency . 

A  siaple  solution  to  the  tr ans pace ncy -coaplexit y  problea 
aay  not  be  easily  obtained.  In  spite  of  the  professional 
rhetoric  to  tae  contrary,  Gass  [ la ]  has  found  an  increase  in 
the  use  of  coaplex  aodels  at  all  levels  of  govecnaent  and 
industry.  He  attributes  this  to  better  trained  analysts  and 
the  developaent  and  refinement  of  ae thodologies.  Although 
siaple  aodels  with  readily  understood  assuaptions, 

relationships  and  structure  are  preferred,  ;ass  contends 
that  decision  aaking  problea  environments  representative  of 
the  Federal  Govecnaent  spnere  cannot  be  realistically  or 
logically  contained  by  siaple  aodels.  Furtheraore,  senior 
decision  aakers  generally  do  not  possess  a  detailed 
understanding  and  appreciation  of  the  aethodologies  employed 
in  the  various  aodels  employed  to  assist  thea  in  the 

decision  aaking  process.  What  is  needed  is  a  method 

through  which  the  use  and  interpretation  of  the  outputs  of 
aodels  by  senior  decision  aakers  is  facilitated.  A  aodel  is 
usable  only  if  it  is  understood  and  plausible  to  analysts 
and  decision  aakers.  They  (particularly  tae  decision  aaker) 
aust  be  given  the  opportunity  to  explore  the  use  of  tae 
aodel,  becoae  faailiar  with  its  predictions,  and  exaaine  the 
relationships  and  assuaptions  iaplied  by  the  aodel.  In 
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actuality  the  deaands  on  their  tiee  generally  preclude 

decision  Bakers  being  involved  at  the  detail  levels  iaplied 
above.  Therefore,  it  is  incuabent  upon  analysts  to  evaluate 
the  aodels  they  use  so  that  they  are  in  a  position  to 

recoaaend  to  the  decision  aaker  to  use  or  not  use  the 

outputs  of  a  particular  aodel.  This  iaplias  intiaate 

knowledge  of  the  essence  of  a  aodel. 


c.  surras? 


To  reduce  unnecessary  proliferation  and  reduce  costs  the 
Coaptrolier  General  has  recoaaended  aodel  sharing  when 
feasible.  Sharing  a  aodel  requires: 

•  ability  to  use  it  with  ainiaal  conversion; 

■  adequate  facilities  to  run  the  aodel; 

•  sufficient  coapetent  analysts  and  prograaaers; 

•  adequate  docuaentat on; 

■  foraalized  arrangeaents  for  cost  sharing  and 
coordination. 

Findings  indicated  that  the  great  coaplexity  of 
theatre- level  aodels  coupled  with  rapid  turnover  of 
personnel  has  resulted  in  aodels  being  used  as  "black  boxes" 
with  neither  the  coaputer  technicians  that  run  the  aodel  nor 
the  analysts  knowing  explicitly  what  or  how  the  aodel 
operated  on  the  input  data  to  provide  the  final  results  or 
output.  Hence,  the  analyst  was  unable  to  adequately  explain 
the  results  to  the  decision  aaker;  with  each  occurence  the 
credibility  of  aodeling  diainished.  Concurrently  aodels 
had  proliferated  to  such  a  degree  that  the  turnover  of 
personnel  exacerbated  an  already  critical  personnel  shortage 
situation.  Aaelioration  requires  reduction  of  the  nuaber  of 
aodels  in  use  and  detailed  justification  before  developing  a 
new  aodel.  [1}  Reduction  or  the  ainiaizstion  of  the  growth 
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of  the  aodel  inventory  implicitly  requires  that  Models  be 
easily  and  quickly  aoveable  fros  one  using  agency  to 
another,  i. e.  posses  transferability.  Key  to  the  resolution 
of  the  probleas  of  complexity  and  transparency  is 
docuaentation. 

e 

Coaplexity  nay  be  an  unavoidable  recourse  of  coabat 
aodeling  because  of  the  deaands  of  aanagers  and  decision 
aakers.  Unless  coaplex  aodels  are  sufficiently  docuaented 
to  sake  then  readily  understandable  and  usable,  analysts 
Mill  create  a  nee  aodel.  Rather  than  creating  new  aodels 
an  ataosphere  conducive  to  the  sharing  of  aodels  should  be 
incouraged.  Requirements  to  transfer  a  aodel  are  discussed 
in  the  next  chapter. 
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it.  n  mum  k  aoeit 


The  Review  of  Selected  Any  Rodels  report  [  1  ]  proposes 
that  the  ausber  of  sodels  retained  by  the  Dept,  of  the  Aray 
be  reduced  and  that  existing  sodels  be  used  where  possible 
before  a  new  aodei  is  coaaissioned.  To  properly  evaluate  an 
existing  aodei  a  aet hod  for  analyzing  and  verifying  a 
candidate  or  candidates  froa  existing  aodei  resources  aust 
be  established.  The  aore  coaplex  a  aodei  is  the  aore 
difficult  is  this  analysis  and  verification.  [14] 

Use  of  an  existing  aodei  requires  understanding  of 
potential  probleas  due  to  aodei  design  as  well  those 
probleas  expected  to  be  encountered  during  transfer  and 
execution.  Design  probleas  can  include  lack  of  adequate 
sub-eodels,  failure  to  consider  key  variables,  inaccuracies 
or  lack  of  validation,  computational  difficulties,  and 
inconsistent  hidden  assuaptior.s.  Probleas  during  erection 
can  be  those  of  irrelevance,  inadequacy  of  output, 
inappropriateness  of  assuaptions,  lack  of  connection  to 
other  aodels  and  results,  statistical  and  extrapolation 
difficulties . 

A.  1ETHOD0L03T  PDR  AVALfSXS  OP  EXISTING  SODELS 


Defore  an  existing  aodei  can  be  used  it  aust  be  analyzed 
by  the  potential  user.  Exaaination  of  the  literature  for  a 
aethodology  for  conduct  of  an  analysis  generally  produces  a 
concensus.  Such  aethodologies  center  on  five  general  areas. 
[20  ]  These  are: 
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(1)  inputs  and  outputs,  i.e.  the  global  structure  of  the 
aodel; 

(2)  the  basic  causil  relationships  assused  between 
earianles;  i.e.  the  local  structure  of  the  aodel; 

(3)  the  detailed  logic  of  the  aodel; 

(4)  the  nuaerical  values  of  the  data,  and 

(5)  the  tiae  and  resources  required  to  exercise  the 
aodel. 

Additionally ,  an  analysis  should  consider  any 
experiaental  studies  that  allow  coaparison  of  the  aodel 
predictions  with  the  real  world,  other  aodels  or  with  the 
intuitive  aeliefs  of  the  decision  saner  that  will  ultiaately 
be  presented  the  outputs  and  their  interpretation.  Such 
previous  studies  are  useful  in  evaluation  of  a  aodel  for 
application  to  new  probleas  or  situations.  Unfortunately, 
so  far  as  coabat  aodels  ace  concerned,  coaparisons  with  real 
world  results  are  extreaely  liaited.  When  such  data  is 
available  (e.g.  VWXI  and  Korea)  it  is  sparse,  subject  to 
conflicting  interpretation,  and  of  questionable  accuracy. 
C  2»] 


A  detailed  exaaination  of  the  glooal  structure  of  a 
aodel  can  forthrightly  answer  the  basic  question  of  such  an 
analysis.  Zs  this  aodel  capable  of  exaaining  the  problaa 
at  hand7  The  potential  user  is  interested  with  whether  the 
outputs  aeasure  the  desired  quantities  and  or  qualities,  and 
whether  the  desired  inputs  can  be  entered  into  the  aodel  la 
the  fora  in  which  they  ace  available.  Osing  an  existing 
aodel  is  not  cost-ef feet ive  if  available  input  data  aust 
undergo  a  costly  and  tiae  consuaing  conversion.  There  aust 
be  provisions  in  the  aodal  structure  to  allow  changes  in  the 
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input  data  to  reflect  chinges  in  the  coabat  process  >*nd«r 
exaaination. 


Tha  local  structuca  is  exaained  to  expose  iaportant 
causal  influences  which  aay  hava  baan  onittad  for  aasa  of 
coaputational  affort  or  othar  raasons.  This  stap  is  closely 
ralatad  to  tha  abstraction  process  in  tha  design  of  taa 
■odal.  It  is  aost  dependent  on  tha  detail  and  roapleteness 
of  available  iocuaentation.  It  is  critical  because  tha 
iaportanca  of  a  causal  connection  can  be  quite  subtle  but 
very  pervasive. 

Exaaination  of  the  detailed  logic  of  a  aodel  identifies 
the  hypothesis  upon  which  the  aodel  is  basel.  It  reveals 
extent  to  which  it  is  based  on  historical  and  experiaental 


field  data.  It  is  another  indicator  of  the  appropriateness 
of  tha  aodel  to  solve  the  problea  at  hand.  This  step  also 
reveals  the  presence  of  inconsistent  assuaptions  or 
inappropriate  assuaptions. 


Finally,  analysis  of  the  tiae  and  resources  required  by 
the  aodel  provides  the  aaans  througn  which  the  costs 
associated  with  the  use  of  the  aodel  can  be  deterained.  To 
aake  rapid  and  accurate  sstiaates  the  description  of  tha 
aodel  aust  provide  explicit  inforaation  of  tiae  requireaents 
to  gather  and  prepare  required  inputs  as  well  as  the  tiae  to 
execute  the  aodel  given  the  inputs. 

If  aodels  are  to  be  truly  transferable  between  agencies 
the  above  analysis  aust  be  coaleted  prior  to  any  atteapt  to 
transfer  a  aodel.  Accurate  and  coaplate  docuaenti tion  aust 
be  available  if  this  is  to  be  conducted.  Such 
docuaentation  will  be  available  only  if  it  is  prepared 
concurrently  with  the  developaent  of  a  new  aodel  and  in 
concert  with  any  aodif ications  aade  during  the  life  of  the 
aodel. 
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B.  POTENTIAL  PBOBLBBS  III  EXISTING  SO  DELS 


To  adequately  analyze  an  existing  aodel  the  analyst  aist 
be  faailiar  with  potential  ptoblee  areas.  Parrell  [20]  has 
suggested  that  the  analyst  consider: 

(1)  the  adequacy  of  subaodels,  i.e.  do  they  aodel  what 
they  purport  to  aodel; 

(2)  whether  hey  variables  were  overlooked  during  the 
process  of  aostraction; 

(3)  the  possibility  of  inherent  inaccuracies; 

(4)  possible  coaputational  1  if f icu lties; 

(5)  whether  the  nodal  has  inconsistent  and  inapproriate 
assuaptions; 

(6)  possible  inadequacy  of  output. 

Aaong  the  probleas  of  design  can  be  found  cases  where 
the  general  aodel  structure  is  adequate  but  reasonable 
subaodels  are  not  available.  This  is  particularly  true  of 
sub-aodels  involving  siaulated  tactical  or  strategic 
decision  taking.  Parrell  [20]  has  indicated  that  aost 
diagraas  and  flow  charts  of  such  sub-aodels  do  not  reveal 
the  sub-aodel  inadequacy. 

In  designing  a  aodel  the  first  and  aost  difficult  step 
is  insightful  abstraction  by  the  aodeler  or  aolelers.  To 
abstract  the  real  world  into  a  representative  aodel,  key 
variables,  their  basic  causal  relations  and  interpretation 
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aust  be  incorporated  into  the  aodel.  This  step  is  eery 
difficult  to  verbalize  since  any  description  of  the  process 
to  be  aodeled  will  necessarily  incorporate  the  results  of 
abstraction  in  the  eleaents  of  the  description.  This  step 
is  iaaginative,  creative,  and  coaplez;  it  is  iaperative  that 
it  be  docuaented  at  the  tiae  of  abstraction.  Once  a 

process  has  been  aodeled  and  tiae  passes  the  explicit  steps 
and  reasoning  thru  which  the  abstraction  was  aade  cannot  be 
adequately  described  by  the  aodelers.  Failure  to  consider 
hey  variables  occurs  at  this  alaost  invisible  step  of 
abstracting  a  process  of  the  real-world  into  a  aodel  or 
sub-aodel. 

In  the  review  of  an  existing  aodel  it  is  these  alaost 
invisible  steps  of  abstraction  that  aust  be  thoroughly 
exaained  to  insure  all  key  variables  are  included  in  the 
aodel.  Key  variables  can  also  be  excluded  because  of  lack 
of  adequate  submodels  or  coaputational  probleas  their 
inclusion  or  aanipulation  would  precipetate.  The  reviewer 
or  user  of  an  existing  aodel  aust  carefully  search  for  key 
variables  that  have  not  been  aodeled  or  are  siaply  thruput 
in  the  aodel. 

Another  pitfall  hidden  in  the  design  of  existing  aodels 
is  inaccuracy  or  lack  of  validation.  Often  because  of 
coaputational  difficulties  known  experiaental  results  have 
not  been  included  in  a  particular  aodel.  This  occurs  aost 
often  as  a  result  of  exigencies  on  the  aodeler  or  aodelers 
at  the  tiae  the  aodel  is  created.  Exclusion  of  such 

experiaental  data  results  in  inaccuracies.  Lack  of 
experiaental  support  for  portions  of  ailitary  aodels  is 
another  coaaon  cause  of  inacuracies  which  cannot  always  be 
avoided.  Likewise,  inadequate  debugging  of  tha  aodel  can 
be  a  reality.  This  is  not  serious  as  long  as  these 

inaccuracies  are  known.  Unfortunately,  these  facts  can 

escape  a  potential  user  if  a  careful  review  of  the  aodel 
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design  and  its  use  is  not  eade 


A  thorough  review  of  nodal  docuaentation  can  reveal 
coaputational  difficulties  if  the  docuaentation  is 
adequate.  These  difficulties  usually  involve  either 
algorithaic  iaprecision  or  excessive  data  storage 
requireaents.  These  lisitations  should  oe  revealed  by  the 
docuaentation  to  the  potential  user  so  that  proper  use  of 
the  aodel  can  be  aade,  unexpected  or  excessive  costs  are  not 
incurred  or  another  aodel  can  be  selected. 

The  bane  of  analyst  using  an  existing  aodel  is 
inconsistent  hidden  assuaptions.  Such  assuaptions  included 
as  part  of  the  overall  aodel  can  be  at  odds  with  those  of 
sub-aodels,  the  data  base,  and  data  generating  routines. 

The  aost  pervasive  error  awaiting  the  unwary  user  of  an 
existing  aodel  is  the  inappropriateness  of  inherent 
assuaptions.  This  potential  error  is  the  aost  difficult 
to  detect  when  using  a  pre-deslgned  coabat  aodel,  since  the 
user  is  generally  not  well  versed  in  the  process  through 
which  the  abstraction  of  the  real  world  was  aade.  During 
the  abstraction  fundaasntal  assuaptions  concerning  the 
nature  of  the  coabat  process  as  well  as  assuaptions  for 
coaputational  reasons  were  aade.  Only  through  careful  study 
of  the  line  of  reasoning  followed  at  the  creation  can  a 
would-be  user  becoae  faailiar  with  these  assuaptions.  Care 
aust  be  taken  so  that  not  only  the  explicit  but  also  the 
iaplicit  assuaptions  are  understood  and  their  effect  on  the 
coabat  process  being  aodeled  is 
coaprehended.  Onf ortunatel y,  the  reasoning  and  logic 
followed  in  creation  of  a  aodel  are  not  included  in  current 
docuaentation. 


If  there  arc  potential  probleas  awaiting  the  unwary 
analyst  in  tbs  design  of  an  existing  nodal,  these  are  just 
the  forebodings  of  greater  probleas  associated  with  the 
actual  exercise  of  the  aodel.  Forenost  of  these  is 

irrelevance,  that  is  caused  by  either  atteapting  to  use  a 
aodel  on  a  problea  for  which  it  was  not  designed  or  a 
failure  to  understand  the  problea  thoroughly  enough  to 
select  an  appropriate  aodel. 

Concoaitant  with  irrelevance  is  inadequacy  of 
output.  This  results  when  useful  inforaation  is  inherent  in 
the  aodel  itself  out  actual  calculation  and  or  display  does 
not  exist.  Causes  of  sich  conditions  are  selection  of  an 
iaproper  aodel  or  lacX  of  full  understanding  of  the 
intricacies  of  the  aodel.  Proper  and  adequate 

docuaentation  and  caraful  perusal  will  aaeliorate  the 
situation. 

In  coaplex  simulations,  both  situations  and  hey 
paraaeters  will  be  varied  and  the  results  exaained.  The 
nuaber  of  unique  situations  exaained  is  liaited  by  resource 
and  tiae  constraints,  because  of  this  the  potential  user 
aust  be  sure  that  required  outputs  are  readily  available. 

Adequate  descriptions  of  the  output  of  any  randoa 
process  are  difficult  to  achieve  under  the  best 
conditions.  Under  tiae  constraints  descriptions  of  the  type 
of  output  provided  by  a  aodel  as  well  as  how  the  outputs  are 
collected  is  critical.  aithout  it,  the  user  cannot 
correctly  interpret  the  results  obtained,  ihen  available 
tiae  and  rasources  preclude  siaulating  all  situations  the 
problea  of  extrapolating  or  interpolating  between  the 
particular  situations  aodeled  arises.  There  is  no  adequate 
general  nethod  for  suraounting  this  problea;  the  problea  is 
less  severe  the  less  coaplex  la  tha  aodel  being  used.  Any 
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statistical  difficulties  encountered  only  compound  the 
problea.  Sursounting  this  probles  is  a  function  of  the 
ingenuity  of  the  analyst  and  the  detail  of  the  docusentation 
available  to  his.  In  the  case  of  theatre- level  cosbat 
aodels  obviously,  neither  all  situations  can  be  sisulated 
nor  are  there  adeguate  historical  or  experiaental  data  with 
which  to  coapare  the  results  obtained.  I  thorough 
accurate  and  consistent  Interpretation  of  the  outputs  of 
such  a  sodel  is  highly  dependent  on  the  analysts  intiaate 
fasilianty  with  the  aatheaatical  structure  within  the  sodel 
as  well  as  interactions  between  the  various  input  and  output 
data.  Such  intinacy  is  obtainable  only  through  available 
docusentation  if  the  analyst  uses  an  existing  sodel  designed 
by  soseone  else. 

C.  SUBHART 

Transfer  of  existing  aodels  between  agencies  is  one  way 
of  reducing  proliferation.  Prior  to  such  a  transfer  a 
potentionall y  usable  sodel  aust  be  analyzed  for 
applicability  and  approriateness .  Such  an  analysis  should 
consider : 

•  inputs  and  outputs; 

■  basic  causal  relationships; 

■  sodel  logic  and  structure; 

■  available  data  and  required  data; 

■  tine  and  resources  required. 

Sany  potential  probleas  are  contained  in  an  existing 
sodel,  asong  these  are: 

•  subaodel  inadequacy; 

■  key  variables  excluded; 

•  inherent  inaccuracies; 

•  conputational  difficulties; 
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•  inconsistent  assumptions; 

•  inappropriate  assumptions; 

■  inadequate  output. 

The  ability  and  to  ehat  degree  model  analysis  and 
consideration  of  potential  problems  can  be  accomplished  is 
determined  to  a  great  degree  by  available 

documentation.  Adequacy  of  documentation  is  considered  in 
the  next  chapter. 
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A.  DEFINITIONS  AND  BACKGROUND 

Program  documentation  is  a  collection  of  information  to 
explain  the  design,  development,  and  aaintenance  of  the 
prograa  as  well  as  purposes,  methods,  logic,  relationships, 
capabilities  and  liaitations.  [5]  Except  for  tna  siaplest 
prograas  it  is  difficult,  if  not  impossible,  for  someone 
other  than  the  originator  to  deteraine  what  is  supposed  to 
be  accomplished  by  just  reading  the  prograa  cole. 

Documentation  is  necessary  for:  planning,  programming, 
managing,  operating  and  evaluating  models.  It  is  absolutely 
essential  for:  quick  and  effective  changes;  use  of  the 
model  by  programmers  and  analysts  other  than  the 
originators;  understanding  of  what  is  being  done; 
interagency  prograa  sharing;  verification  of  proper  model 
operation.  Through  adequate  documentation  secondary  users 
gain  an  understanding  of  a  model  and  thus  the  model  and  its 
outputs  are  rewarded  a  level  of  credibility.  It  is  vital 
if  secondary  users  are  to  be  able  to  run  the  model  and  make 
necessary  modifications  of  the  prograa.  This  restrains 
proliferation  and  duplication  which  can  result  in  major 
savings;  besides  it  tempers  an  already  complex 
environment.  Unfortunately,  current  documentation  practices 
are  such  that  the  documentation  to  facilitate  the  use  of 
existing  models  generally  does  not  exist. 
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a.  CURB  ENT  OOCOMENTRTIOS  PRACTICES 


Although  docuaentation  is  an  aspect  of  computer 
prograaaing  that  was  recognized  froa  the  inception  of 
autoaatic  data  processing  as  being  critical  to  successful 
prograaaing,  it  has  been  and  still  is  a  aajor  problaa 
area.  Unfortunately,  for  various  reasons  including  tiae  and 
fiscal  constraints  as  well  as  lack  of  definitive  guidance 
concerning  requireaents  and  standards,  tne  bulk  of  the  work 
effort  concerning  docuaent ation  has  consisted  of  unfulfilled 
requireaents.  Notwithstanding  the  fact  that  prograaaing 
has  existed  since  the  inception  of  SHI AC  in  1944,  the  lack 
of  adequate  doca sent ation  received  aajor  attention  in 
studies  concerning  aodels  and  siaulations  as  weld,  as 
investigations  by  the  Coaptroller  General  of  the  Aray  in  tne 
late  sixties  and  early  seventies.  [10,15] 

Irrespective  of  the  aforeaentioned  studies  tae  problea 
of  inadequate  docuaentation  persisted  and  was  the  subject  of 
another  investigation  oy  the  Coaptroller  General  in 
197u.  [15]  Over  seventy  federal  installations  in  the 
continental  United  States,  Europe,  and  Asia  were 
surveyed.  These  included  selected  300  Agencies  as  well  as 
those  of  each  of  the  arasd  forces. 

The  study  cited  several  problea  areas  attributable  to 
inadequate  docuaentation.  Increased  cost  of  operations  was 
high  on  the  list.  Beciuse  of  inadequate  docuaentation  use 
of  operating  prograas  is  hindered  since  current  operators  do 
not  fully  understand  how  and  what  is  being  done  in  a 
prograa.  Therefore,  when  unexpected  outputs  are  obtained 
it  is  difficult  if  not  iapossible  to  deteraine  their 
validity.  Equally  perplexing  is  inadequate  docuaentation  of 
subsequent  aodif ications  incorporated  into  the  aodel.  In 
aany  cases  without  adequate  docuaentation  it  was  iapossible 


for  a  new  analyst  an)  or  prograaaer  to  use  or  aodify  an 
existing  prograa.  Oltiaately  such  aodels  have  to  be 
coapletely  rewritten  or  the  tiae  required  to  aake  thee 
usable  was  greatly  in  excess  of  the  tiae  required  when 
adequate  docuaentation  was  available.  In  a  cited  exaaple 
inadequate  docuaentation  caused  an  agency  to  spend  over  a 
year  to  deteraine  how  a  particular  coeplex  aodel 
operated.  Another  exaaple  indicated  the  difference  of  six 
aan-aonths  of  work  incurred  because  of  the  lack  of 
sufficient  docuaentation.  Although  the  Coaptroller  General 
found  it  difficult  to  deteraine  the  aggregate  cost  of 
increased  operating  expenses  due  to  inadequate 
docuaentation,  he  did  indicate  it  was  high  because  of  the 
nuaber  of  cases  uncovered. 

Lack  of  sufficient  docuaentation  was  the  aa^or  cause  of 
the  prooleas  encountered  oy  the  author  during  the  conversion 
of  the  ATLAS  aodel.  rfhen  aachine  differences  required 
changing  the  prograa  code  there  was  ainiaal  guidance  as  to 
whicn  sections  of  the  code  corresponded  to  particular 
functions  described  in  the  user's  annual.  ‘22]  Also, 
details  of  the  aatheaatical  structure  of  ATLAS  are  not 
contained  in  the  annual.  For  details  of  the  aodel 
structure  references  are  aade  to  a  aodels  annual  [23]  for 
the  predecessor  of  ATLAS.  The  extent  to  which  the  structure 
of  this  aodel  has  been  incorporated  into  ATLAS  is  not 
explicitly  stated.  The  situation  is  further  coaplicated  by 
the  fact  that  pertinent  assuaptions  basic  to  the  aodel 
foraulae  are  not  in  the  aodels  annual;  they  are  in  the 
user's  annual  listed  in  a  haphazard  Banner.  Since  the 
aodels  discussed  were  originally  designed  for  the 
predecessor  of  ATLAS  there  is  no  assurance  that  changes  to 
the  aodel  foraulae  were  not  aade  during  the  evolution  of 
ATLAS.  This  suspicion  is  anhar.ced  by  the  fact  that  in  1973, 
five  years  after  the  design  of  ATLAS,  a  significant 
prograaaing  error  was  found.  [  24  ] 
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There  ire  a  ayriad  of  reasons  why  eodel  docuaentation  is 
inadequate.  One  of  the  priaary  causes  is  that  docuaentation 
guidelines  and  policies  are  developed  by  individual  Federal 
departaents  and  agencies,  it  the  highest  levels  the 
guidance  is  necessarily  general,  as  it  aoves  down  the 
organization  further  aore  explicit  iapleaentiag  directives 
are  provided  culainating  in  directives  issued  by  the 
developing  agency.  Hence,  soae  docuaentation  is  brief  and 
siaplistic;  other  docuaentation  is  detailed,  voluainous  and 
coaplex;  neither  aay  prove  to  be  adequate.  Adequacy  is 
deterained  by  the  ability  of  other  than  the  originators  to 
use  and  understand  the  aodel.  The  Coaptrcller  General  found 
that  even  when  guidelines  and  standards  were  prescribed 
aanagers  of  aodeling  projects  failed  to  insure 
coapliaace.  The  type  and  content  of  docuaentation  is  often 
decided  by  coaputer  technicians  or  AO P  operators.  [15] 
Shubik  [  17]  has  cited  this  practice  as  unprofessional  since 
aabitious  prograaaers  have  been  known  to  change  coding  in 
the  pursuit  of  coaputing  efficiency  without  salting  note  of 
the  fact. 

An  exaaination  of  264  aodel  docuaentation  packages  at  10 
California  installations  revealed  none  fully  coaplied  with 
the  agency  standards  and  aost  were  incoaplete,  inconsistent, 
and  inadequate.  [15]  In  aost  cases  prograaaers  deterained 
what  docuaentation  to  prepare  based  on  their  own 
judgeaent.  Managers  responsive  for  developing  aodels 
indicated  that  the  reason  standards  were  not  adhered  to  was 
because  of  tiae  contraints.  Coapletion  dates  frequently 
were  given  precedence  over  preparation  of  adequate 
docuaentation.  The  desire  to  coaplete  a  aodel  and  get  it 
operational  by  a  given  date  overrode  the  need  for 
docuaentation. 
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An  aspect  of  aanagerial  responsibilities  concerning 
documentation  is  that  it  be  kept  current.  Even  if  a  aodel 
is  initially  adequately  documented  it  Mill  eventually  be 
modified  and  its  documentation  must  be  likewise 
updated.  This  is  a  major  problem  because  it  requires 
diligence  to  update  documentation.  Siven  time  and  resource 
constraints  and  the  exigencies  of  the  decision  making 
process  it  i3  a  task  that  can  easily  be  put  off  since  the 
aodel  Mill  Mork  without  such  documentation.  The  problem 

comes  later  when  the  personnel  that  modified  the  program 
become  involved  with  other  demanding  problems,  leave  or  are 
transferred.  Later  the  documentation  is  difficult  to 
prepare  because  the  reasons  why  or  how  the  modification  was 
made  become  unclear  or  those  that  knew  what  was  done  are  no 
longer  available. 

There  are  numerous  comment  cards  in  the  ATLAS  program 
that  indicate  changes  were  made.  However,  there  is  no 
formal  documentation,  with  one  exception,  to  indicate  what 
or  how  these  changes  were  made.  Informal  documentation 
provided  was  minimal  and  superficial  and  did  not  address  all 
the  indicated  changes.  The  one  exception  was  a  formal 
document  [25]  prepared  in  1974,  which  discussed  improvements 
in  the  treatment  of  barriers  and  personnel  replacements.  A 
global  variable  and  subroutine  listing  were  provided  but 
these  were  not  up  to  date;  had  they  been  current  the 
conversion  would  have  been  facilitated. 

Poor  or  nonexisting  documentation  persists  irrespective 
of  the  efforts  of  the  Comptroller  Ceneral  and  the  Department 
of  Defense.  Inspite  of  the  identification  of  this  problem 
early  in  this  decade  [1,10,15]  its  presence  continues  to  be 
a  problem  at  the  close  of  the  decade.  [3]  The  continuing 
lack  of  detailed  documentation  that  enables  an  analyst  to 
understand  what  goes  on  inside  a  aodel  is  cited  by  Shupack 
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(26]  in  1979 ,  as  a  Halting  factor  in  the  use  of 
theatre- level  coebat  aodels.  Although  there  was  a 
noticeable  iaproveaent,  he  found  the  level  of  docuaentation 
of  IDAGAB  not  sufficient  to  insure  the  easy  and  proper  use 
of  the  aodel  without  suppleaenting  the  available 
docuaentation.  Without  adequate  docuaentation  tae  analyst 
is  apt  to  sake  erroneous  conclusions  regarding  the  processes 
occurring  within  a  aodel. 

Although  docuaentation  probleas  persist  genuine  atteapts 
to  resolve  the  probleas  have  been  aade.  Current  coabat 
aodeling  efforts  at  the  Naval  Postgraduate  School  are  not 
only  using  languages  especially  designed  for  siaulation  but 
the  docuaentation  aethods  eaployed  enhance  the  transparency 
of  the  aodel.  For  exaaples  see  Ref.  27,  28,  29.  Other 
agencies  have  also  aade  inroads  toward  iaproving  the 
adequacy  of  docuaentation.  See  Ref.  30,  31, 
32.  Irrespective  of  these  iaproveaents  the  author  believes 
a  vital  aspect  of  docuaentation  is  being  overlooked.  This 
aspect  and  appropriate  recoaaendations  are  set  forth  in  the 
next  chapter. 


C.  SUBBART 


Studies  as  well  as  intuition  reveal  that  to  understand 
the  workings  of  a  coaplax  aodel  an  analysts  requires  a 
detailed  explanation  of  the  calculations  and  data 
aanipulation  perforaed  by  a  siaulation.  Xaplicit  and 
explicit  assuaptions  and  inputs  aust  be  known  if  an  analyst 
is  not  going  to  use  a  aodel  as  a  black  box.  A  detailed 
knowledge  of  the  variables,  subprograas  and  their 
relationships  aust  be  acquired  if  a  aodel  is  to  be 
transferred  froa  one  uaing  agency  to  another.  Rarely  will 
both  organizations  posses  the  saae  brand  of  data  processing 


equipnent,  loce  likely  than  not  there  Mill  be  great 
dissimilarities.  Conversions  fros  on*  sachine  to  another 
requires  that  changes  be  aade  to  the  nodal.  To  change  the 
nodal  the  prograaaer  and  or  analyst  nust  know  the  effect  his 
change  will  have  not  on  only  the  particular  line  of  code  he 
is  changing  but  throughout  the  progran.  Analysts  nust  not 
only  know  hoe  a  change  will  affect  the  physical 
ainipulations  and  conputations  of  the  various  parts  of  the 
nodal  but  how  it  will  interact  with  the  inplict  and  explicit 
assumptions  of  the  aodel.  To  gain  this  level  of 
coepr ehension  of  a  aodel  designed  by  soneona  else  the 
analyst  and  prograaaer  of  the  gaining  organization  nust 
consult  the  docunentat  ion  provided  with  the  aodel. 
Uithout  such  docunentation  analysts  have  chosen  to  construct 
a  new  aodel.  Unfortunately,  the  general  concensus  of  the 
investigations  was  that  docunentation  was  of  dubious  quality 
and  generally  inadequate.  [1,10,15] 
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The  discussion  of  who  ths  asar  is,  the  role  of  the 
officer  analyst,  and  the  docaaentation  concept  that  follows 
is  based  on  seven  years  experience  in  operations  research 
related  assignaents,  discussions  with  analysts,  prograssers 
and  students,  and  probleas  encountered  during  conversion  of 
the  ATLAS  sodel.  The  author  has  drawn  upon  the  above 
sources  and  selected  literature  (4,  15,  17,  33,  34,  35]  to 
propose  a  new  concept  in  aodel  docuaentatioc.  This  new 
concept  is  intended  to  refine  and  supplenent  current 
iocuaentation  aethods.  I apleaentat ion  of  the  proposed 
concept  will  hopefully  fill  a  void  that  currently  exists  and 
will  greatly  iaprove  the  transparency  and  transferability  of 
coabat  aodel. 


A.  THE  0S2B  AND  THS  ANALYST 


Before  proceeding  further  it  is  necessary  to  define  the 
often  referred  "user".  It  is  one  of  the  aore  vague  teras 
associated  with  coabat  aodeling. 

Now,  who  is  the  user?  The  user  is  the  study  director 
and/or  decision  aaker.  These  individuals  need  docuaentation 
that  provides  an  overview  of  the  aodel,  with  indications  of 
its  capabilities  and  liaitatlons  and  general  applicability 
to  the  problea  under  study.  The  details  of  the  conceptual 
basis  of  the  aodel  and  how  and  what  inforaation  can  be 
provided  along  with  an  evaluation  of  its  suitability  should 
be  provided  by  the  analyst. 


The  analyst  Is  tha  sanipolatoc  of  tha  nodal.  Ha  is 
rasponaibla  for  using  tha  nodal  to  support  tha  study 
objectives.  This  naans  ha  is  rasponsibla  for  tha  collection 
and  inaartion  of  input  data  and  intarpratation  of  tha  output 
data.  If  tha  nodal  is  snail*  he  nay  do  tha  coding;  or  if  it 
is  coaplax*  a  prograaaer  nay  assist  hin  in  tha  coding 
procass.  Any  intarpratation  of  how  tha  nodal  raprasants 
raality  is  tha  analyst's  responsibility.  To  fulfill  this 
responsibility  he  aust  be  faailiar  with  tha  conceptual  basis 
of  tha  aodel,  its  underlying  assuaptions,  how  tha  nodal  was 
transforaad  into  the  progran  coda*  and  how  tha  coda  operates 
to  present  the  procass  aodalad.  Tha  analyst  aust  know  if 
any  changes  to  tha  conceptual  foundation  of  tha  nodal 
occurred  in  tha  procass  of  prograaaing  (coding) . 

Thera  is  a  reluctance  on  tha  part  of  nany  nilitary 
analysts  to  gain  an  intinata  understanding  of  a  coaplax 
coaoat  nodal.  Exingencies  of  tha  organization  are  sona  of 
tha  priaa  reasons.  In  tha  daily  deaands  to  ainipulate  a 
aodel  and  to  produce  results  there  is  insufficient 
allocation  of  tine  to  study  tna  inner  workings  of  tha 
nodal.  Eelianca  is  placed  alaost  exclusively  on  tha  user's 
annual  to  explain  tha  results  produced. 

Soae  analysts  (this  is  particularly  true  of  tha  officer 
analyst)  refuse  to  gain  detailed  understanding  of  tha  inner 
workings  of  a  nodal  because  they  do  not  perceive  that  to  be 
their  function.  Thair  perception  is  that  they  are  tha  user 
and  do  not  raguira  that  level  of  detailed  knowledge.  Others 
hesitate  to  learn  or  bacoaa  wall  versed  in  tha  functions  of 
a  particular  nodal  because  they  fear  such  expertise  will 
label  than  and  hence  Unit  tha  scope  of  thair  future 
assignaants.  In  discussions  with  officer  analyst  students 
and  practicing  officer  analysts*  tha  author  found  these 
attitudes  to  be  guita  pervasive,  sany  considered  detailed 
knowledge  of  how  a  nodal  operated  to  be  in  the  reala  of  the 
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prograaaer* s  responsibility.  Little  or  no  consideration  was 
given  to  the  fact  that  aost  prograaaers  have  little  or  no 
ailitary  oackground  and  cannot  possibly  relate  the 
aachinations  of  the  prograa  code  to  the  coabat  process.  The 
prograaaer  views  proper  operation  in  teras  of  proper 
execution  of  prograaaed  instructions.  Hhether  or  not 
instructions  properly  depict  the  realities  of  the  coabat 
process  are  beyond  their  scope  of  interest.  They  have 
neither  knowledge,  inclination  or  experience  to  evaluate  the 
fidelity  of  the  code. 

Attitudinal  attributes  of  ailitary  analysts  can  be 
understood  in  light  of  their  rapid  turnover  in 
assignaents.  sapidity  of  reassignaent  discourages  the 
desire  to  gain  detailed  knowledge  of  any  particular 
aodel.  host  likely  they  will  be  reassigned  shortly,  to 
other  type  duties.  If  subsequent  assignaents  deal  with 
coabat  aodels,  aost  likely,  it  will  be  a  different 
aodel.  Any  tiae  expended  in  the  study  of  details  of  the 
aodel  associated  with  the  current  assignaent  is  considered 
of  ainiaal  value.  Hhen  an  effort  is  aale  to  understand  a 
aodel  it  is  often  frustrated  by  inadaquate  docuaeatation. 

Probably  the  aost  frequent  attitude  seen  in  officer 
analysts  is  the  one  associated  with  the  ailitary  psyche, 
that  of  oeing  a  generalist.  This  attitude  is  the  result 
of  the  total  experience  of  the  profession;  it  has  been  the 
way  to  reach  success  in  the  past,  and  aany  believe  that  it 
still  is  the  way  to  success.  Although  thsra  has  been 
considerable  effort  to  change  this  aind  set,  the  exaaple  of 
the  last  few  centuries  is  difficult  to  overcoae.  Coapared 
to  the  existence  of  the  ailitary  profession,  the  experience 
of  the  ailitary  analyst  is  of  recent  vintage.  Only 
favorable  experience  will  provide  the  iapetus  for  change. 
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The  transfer  of  aodels  between  agencies  will  contribute 
favorably  toward  convincing  analysts  to  gain  detailed 
knowledge  of  coabat  aodels.  If  they  know  that  the  effort 
expended  now  can  be  used  at  a  later  tine  in  soae  future 
assignaent,  the  effort  will  be  considered  worthwhile.  But 
adequate  docuaen tation  is  a  prerequisite  of  such 
transferability.  Hence,  there  is  an  interdependency 
betweeen  iocuaentation  and  convincing  ailitary  analysts  to 
gain  a  detailed  understanding  of  coabat  sodels.  If  they  can 
see  value  in  the  expenditure  of  taa  tise  and  effort,  they 
will  be  willing  to  sake  the  coaaitaent. 

Shubik  [16]  nas  found  that  the  satheaatical  aodeler  and 
the  person  who  understands  the  reality  the  aodel  atteapts  to 
abstract  are  not  necessarily  the  saae  person.  The  coabat 
procass  is  best  understood  by  senior  ailitary  decision 
aakers  who  are  generally  unable  to  translate  it  into  the 
appropriate  abstraction  and  who  generally  desire  greater 
detail  than  is  necessary.  1  good  aodel  is  one  that  is  able 
to  abstract  and  describe  only  that  which  is  relevant  to  the 
problea  under  investigation.  On  the  other  hand  the 
satheaatical  aodeler  is  frequently  an  individual  who 
generally  lacks  the  experience  and  an  appreciation  of  the 
nuances  of  coabat  which  can  lead  to  the  developaent  of  an 
ill-structured  aodel.  The  ailitary  officer  analyst 
represents  a  step  toward  providing  a  aodeler  or  aodel 
operator  who  not  only  understands  the  satheaatical  aspects 
but  the  ailitary  factors  as  well.  If  this  capability  is  to 
be  aaxiaized  when  dealing  with  existing  aodels,  there  aust 
be  docuaentation  which  allows  the  analyst  to  link  the 
conceptual  aodel  foraulation  to  the  executable 
prograa.  Then  he  can  understand  the  conceptual  basis  of  the 
aodel,  insure  the  prograa  fulfills  the  concept,  and  act  as  a 
source  of  inforaation  for  the  decision  aaker. 
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a.  OBIGIH  OP  THE  DOCO SBVTATIOH  SHORTFALL 


The  initial  theatre-  level  coai»at  aodels  used  in  the 
United  States  vara  dasignad  and  oparatad  by  contract 
organizations  (e.g.  Basaarch  Analysis  Corp.).  These  models 
had  a  annual  raCarrad  to  as  a  user's  aanual  which  provided 
an  overview  of  the  aodel,  input  reguireaeats,  and  a 
description  of  the  output.  Por  an  exaapla  see  Bef.  22. 
Docuaenta tion  within  the  annual  was  superficial,  at  aost  it 
provided  the  proverbial  big  picture.  Sufficient 
inforaation  was  provided  to  determine  the  general 
capabilities  of  the  aodel,  possible  suitability  for  a 
particular  study  and  a  general  indication  of  expected 
outputs.  It  provided  little  if  any  inforaation  on  the 
insights  that  could  be  attained  or  subtleties  of  the 
aodel.  The  user  for  whoa  this  "user's  aanual"  was  designed 
was  a  project  aaoager  or  soae  level  of  decision  saker.  The 
details  could  be  filled  in  by  the  persons  who  would  operate 
the  aodel,  this  aost  likely  was  the  designer  of  the 
aodel.  Because  of  budgetary  reasons  and  doubts  that  these 
aodel  operators  understood  the  nuances  of  ailitary 
oparations,  the  decision  was  aade  to  bring  these  nodels 
directly  under  Dept,  of  the  iray  control. 

When  these  aodals  passed  Aray  control  all 

docuaantation  passed  with  thea.  Unfortunately,  in  aost 
casas  the  docuaentation  was  ainiaal  consisting  priaarily  of 
prograa  listings,  oparator  instructions,  global  variable  and 
subroutine  listings,  flowcharts,  user's  aanual  and  possibly 
soaa  liaitad  discussion  of  the  focaulation  of  the  aodal. 
These  aodals  ware  placed  under  control  of  the  agency  that 
would  use  then  in  support  of  force  planning  and  strategy 
studies.  The  designated  users  that  inherited  these  aodals 


wera  the  ailitary  analysts  (officers  and  federal  esployees) 
assigned  to  the  organization  that  received  the  sodels.  The 
analysts  then  took  the  aodel  and  the  user's  annual  and 
proceeded  to  exercise  the  aodel  in  support  of  outgoing 
projects. 

Ose  of  the  user's  annual  by  the  analyst  was  mandated  by 
the  fact  that  input  requirements  and  preparation  were 
contained  in  it.  However,  when  the  aodels  were  initially 
transferred  froa  the  designing  corporation  to  the  Arsy  no 
suppleaental  docuaentation  was  prepared  or 
provided.  Analysts  were  using  a  aanuai  that  provided  only  a 
superficial  exaaination  of  the  aodel.  They  perforaed 
analyses  using  a  aanuai  originally  designed  for  a  study 
director  or  decision  aaker.  These  "user's  aanuals"  did  not 
contain  the  detailed  inforaation  of  the  aodel  that  is 
necessary  if  the  analyst  is  to  know  and  understand  the 
aachinations  through  which  the  input  data  is  exposed  to 
produce  a  given  set  of  outputs. 

Svenually  conflicting  results  were  obtained  froa  aodels 
supposedly  exaaining  the  saae  situation.  ahen  called  upon 
to  resolve  or  explain  thase  discrepancies  the  analysts  were 
unable  to  do  so.  To  explain  the  conflicts  a  detailed 
understanding  of  the  conceptual  oasis  of  the  aodel  as  well 
as  detailed  inforaation  of  the  translation  of  tha  conceptual 
aodel  into  prograa  cole  was  needed.  Only  with  this 
inforaation  could  the  analyst  explain  why  two  aodels 
exaaining  the  saae  coabat  process  under  the  saae  conditions 
produced  different  results. 

Analysts  then  discovered  that  the  docuaentation  provided 
with  the  aodel  did  not  provide  this  insightful 
inforaation.  To  answer  the  question  the  aodel  designer  had 
to  oe  contacted.  At  tines  this  was  iapossible  because  the 
actual  aodel  the  designer  no  longer  was  with  the  fira  that 


developed  the  aodel,  nor  was  there  available  any 
supplemental  information  on  the  inner  workings  of  the  aodel. 
Instances  in  which  the  designer  could  be  located  usually 
proved  just  as  unrewarding.  In  cost  cases  the  designer  had 
no  supplemental  formal  documentation.  When  he  acted  as  the 
operator  of  the  aodel  on  behalf  of  the  Army  he  could  answer 
such  questions  based  on  his  design  knowledge  and  daily 
contract  with  the  model.  Since  there  had  been  no  formal 
requirement  for  such  supplemental  information,  it  never  was 
prepared.  Once  the  model  passed  under  operational  control 
of  the  Army,  the  designer  was  precluded  from  daily 
contact.  Over  time  the  designer's  intimate  familiarity  with 
the  aodel  waned,  especially  the  intracacies  of  the 
translation  from  basic  concept  to  operating  program 
code.  If  the  designer  had  not  done  the  actually  coding, 
similar  results  were  usually  experienced  when  trying  to 
locate  the  original  programmer  or  obtain  supplemental 
information.  What  the  program  code  was  actually  doing  was 
not  readily  apparent  and  documentation  or  personal  knowledge 
of  its  operation  were  unavailable.  The  situation  is  best 
expressed  ay  a  quote  from  Robert  Prost.  When  once  asked  by 
a  critic  what  he  meant  by  a  particular  phrase  in  one  of  his 
works,  he  replied,  "When  I  wrote  it  God  and  I  knew  what  it 
meant,  now  only  God  knows".  This  same  situation  will  also 
prevail  with  combat  models  unless  adequate  documentation  is 
created  concurrent  with  the  design  and  development  of  the 
aodel. 


C.  COBBONICATION  AND  LEVELS  OP  PARTICIPATION 


The  prime  purpose  of  documentation  is  communication: 
communication  of  why  and  how  realities  are  abstracted  and 
condensed  into  a  fora  suitable  for  exercise  on  a  computer  to 
predict  a  future  state  of  some  combat  process.  Generally 
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the  level  of  professional  communication  between  decision 
makers,  analysts,  and  modelers  has  been  low  as  attested  oy 
the  credibility  problem  previously  discussed.  This  coupled 
with  the  turnover  of  military  decision  makers  and  analysts 
has  not  enhanced  coaprehension  of  and  control  over 
large-scale  combat  models.  Very  often  the  information  about 
context  and  limitations  of  these  models  has  not  been  fully 
understood  by  the  military  analyst  and  therefore  not  clearly 
presented  to  the  decision  maker.  Documentation  that  can 
provide  such  enlightenment  to  the  analyst  will  be  a 
significant  step  toward  providing  the  required  insights  into 
combat  models  needed  by  decision  makers.  Through  adequate 
documentation  the  user  and  analyst  gain  understanding,  and 
with  understanding  can  come  acceptance  and  the  decision  to 
use  the  particular  model. 


In  combat  modeling  there  are  three  levels  of 
participation  with  necessary  intercommunication.  At  the 
highest  level  is  the  decision  maker  who  uses  the  model  as  an 
aid  to  gain  insights  and  in  conjunction  with  judgement 
arrive  at  a  decision  concerning  force  structure  or 
strategy.  The  intermediate  level  is  occupied  by  the 
analyst,  who  either  designs  a  model  or  uses  an  existing 
model;  prepares  inputs;  exercises  the  model  and  interprets 
the  outputs.  If  the  model  is  new  to  the  decision  maker  he 
also  aids  in  the  model  selection  process  by  recommending  and 
explaining  the  inherent  attributes  of  particular  models  in 
pursuit  of  a  projected  study.  At  the  lowest  level  is  the 
programmer,  who  writes  the  necessary  code  during  model 
construction,  explains  the  limitations  of  execution  of  a 
model  on  a  particular  computer,  insures  the  model  is 
processed  as  the  program  intended  it  and  to  code  necessary 
modifications  to  a  model.  Each  level  has  unique 
requirements  and  responsibilities  and  therefore  the 
documentation  required  by  each  is  unique. 


52 


The  decision  taker  uses  his  documentation  to  gain  an 
overall  appreciation  of  a  todel  and  sufficient  understanding 
to  question  the  analyst  on  sodel  details  necessary  to  sake  a 
decision  to  eaploy  the  sodel  and  use  its  outputs.  It 
provides  a  leans  of  conducting  discussions  that  can  reveal 
what  insights  can  be  gained  fros  a  particular  sodel.  The 
decision  aaker  uses  his  documentation  as  a  link  between  the 
analyst  and  hisself. 

The  analyst  occupies  the  pivotal  position  between  the 
decision  aaker  and  the  prograaaer.  His  docusentaticn  is 
necessarily  the  lost  broad  in  scope  as  well  as  variation  of 
detail.  It  sust  provide  intiaate  knowledge  of  the  sodel  to 
allow  selection,  sufficient  detail  to  answer  questions  froa 
the  decision  aaker  and  ask  questions  of  the  prograaaer.  It 
sust  provide  the  key  to  the  inner  workings  of  the  model. 

Prograaaer  documentation  allows  the  prograaaer  to 
maintain  and  aodify  tne  lodel  and  answer  the  qaesticns  of 
tne  analyst.  It  allows  the  prograaaer  to  maintain 
efficiency  of  operation  and  insure  execution  in  accordance 
with  the  dictates  of  the  design.  It  aust  clearly  indicate 
how  the  coaputer  interacts  the  inputs  and  prograaaing  code 
to  produce  the  outputs. 

0.  A  CONCEPTUAL  THEORY  OP  SODEL  DOCUMENTATION 

Current  texts  that  describe  the  docuaentat ion  process 
usually  are  texts  on  the  subject  of  coaputer  svsteas.  The 
guidance  provided,  though  atteapting  to  be  general,  is 
oriented  toward  docuaentation  of  programs  that  are  bulk 
processors  of  systeaatic  information,  i.e.  financial 
records,  adainistrati ve  records  etc.  Most  emphasis  is 
placed  on  how  to  use  the  available  prograa  to  process  the 


data  available,  ainiaal  eaphasis  is  directed  toward  how  the 
processing  is  accoap  lished,  because  the  processing  is  not 
coaplex  but  routine  and  easily  understood.  For  an  exaapla 
see  Ref.  33. 

In  the  field  of  coabat  aodeling  little  guidance  is 
available  in  the  fora  of  textbooks  describing  docuaentation 
aet hodologles .  In  order  to  aaxiaize  detailed  understanding 
as  well  as  transferability  of  coabat  aodels  a  new  concept  of 
docuaentation  is  proposed  and  set  forth  in  this  section. 

To  fulfill  the  reguireaents  discussed  above  the 
docuaentation  aust  provide  the  coaplete  understanding  of  how 
the  aodel  was  created,  underlying  assuaptions,  explicit 
description  of  the  foraulations  and  nuaerical  aethods 
eaployed  and  detailed  description  of  the  aechanics  of  the 
prograa  code  and  its  execution.  Sost  current  docuaentation 
described  as  a  user's  aanual  (e.g.  see  Ref.  22),  executive 
suaaary  or  by  soae  siailar  title  is  sufficient  to  fulfill 
the  proposed  non-technical  docuaentation  that  follows. 
?rograaaer's  docuaentation  is  widely  described  in  the 
literature  of  coaputer  systeas  and  needs  just  a  few 
additions  in  respect  to  coabat  aodels.  kssuaing  that  the 
docuaentation  is  provided  as  described  in  the  Literature, 
ainiaal  aodification  is  required..  Priaarily  this  is  a 
charting  and  cataloging  procedure  to  allow  ease  of  tracing 
variables  through  the  prograa  and  understanding  the  linking 
of  3uoprograas  to  the  aain  prograa.  Current  docuaentation 
reguireaents  stress  flowcharting.  Flowcharting  is 
coaparable  to  electronic  scheaatics  and  allows  one  to  see 
the  logical  flow  of  the  process  being  prograaaed.  In  the 
coding  step  this  logical  flow  is  translated  into  a 
aechanical  flow  of  variables  through  aatheaatical  and 
logical  foraulations  and  suoprograas.  k  charting  procedura 
will  be  like  a  blueprint  that  shows  the  physical  connection 
of  the  aain  and  subprograas.  The  catalog  will  explicitly 
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state  how  variables  are  interacted  and  passed  between 
subprograas. 

Por  the  analyst's  documentation  a  new  concept  is 
proposed.  Bather  than  describing  the  aodel  in  the 
traditional  aanner,  i.e.  froa  the  context  of  justification, 
the  analyst's  docuaentat ion  should  be  presented  froa  the 
context  of  discovery.  [2]  Using  the  traditional  concept  the 
aodel  is  docuaented  by  stating  the  issuaptions  of  preaises 
wnich  deteraine  the  outputs  of  the  aodel,  showing  the  final 
aatheaatical  foraulae  that  represent  the  abstractions  of  the 
reinvent  characteristics  of  the  aodelsd  process,  discussing 
tne  inputs  required  to  support  the  given  foraulae,  and 
listing  the  outputs  that  ran  be  obtained  froa  the  aodel  and 
inputs. 

This  is  not  tae  aanner  in  which  the  aodel  was  foraulated 
and  such  locuaentation  in  the  context  of  justification  does 
not  enlighten  the  analyst  in  teras  of  how  the  designer 
arrived  at  this  particular  abstraction  of  the  coabat 
process.  One  aust  conclude  that  this  type  of  doc uaen tation 
is  not  of  great  help  to  the  inexperienced  analyst  if  he  is 
atteapting  to  understand  the  essence  of  a  coabat  aodel.  If 
the  analyst  is  to  gain  a  intiaat*  knowledge  of  the 
functioning  of  a  aodel,  ha  aust  be  able  to  ascertain  how  the 
aodel  case  to  be.  This  provides  hia  two  invaluable 
insights.  first,  he  gains  an  insight  into  the  abstraction 
process  of  the  designer.  It  is  a  gliapse  of  the  reasoning 
procsess  by  which  the  designer  cut  through  the  ayriad  of 
details  to  deduce  the  fundaaental  variables  that  allow  a 
aodel  to  approximate  the  coaplexity  of  a  given  coabat 
process  without  having  to  aodel  each  of  the  aultitudinous 
factors  that  coapose  the  actual  process.  Second,  he  gains 
knowledge  of  the  factors  that  were  considered  as 
representative  of  the  coabat  process  but  were  discarded 
because  they  seesed  not  to  be  necessary  predictors.  This 
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step  ia  itself  is  worth  the  cost  of  providing  this  type  of 
documentation.  tfhat  it  provides  is  a  historic  record  of 
factors  and  related  assumptions  considered  and  reasons  why 
they  were  ultimately  rejected  or  accepted.  The  information 
provided  must  be  succinct  and  allow  understanding  of  the 
abstraction  process  witaout  introducing  voluminous  detail 
and  unnecessary  costs.  This  will  be  an  aid  not  only  for 
the  follow-on  analyst  but  all  those  that  come  later.  Zt 
will  preclude  subsequent  analysts  from  expending  time  and 
money  to  determine  why  particular  factors  are  or  are  not 
modeled.  Hence,  if  they  wish  to  modify  or  elaborate  upon  a 
combat  model  and  Information  about  previously  considered  and 
rejected  alternatives  is  available,  the  expenditure  of 
resources  to  reinvestigate  a  particular  alternative  and  gain 
only  duplicate  information  will  be  precluded. 

2.  32JUIH2D  L2VELS  OF  DJZQ  HEHT  KTIOS 

111  the  evidence  gathered  indicates  three  levels  of 
documentation  for  models  are  required.  These  levels  of 
documentation  are: 

(1)  decision-maker  level,  (facilitates  communication 
betveen  the  decision  maker  and  analyst); 

(2)  analyst  level  (fosters  communication  betwmen  analyst 
and  decision  aaker  and  enhances  working  relationship  with 
the  programmer)  ; 

(3)  programmer  level  (provides  detailed  understanding  of 
pro^raa  code  and  facilitates  cossunication  eith  the 
analyst)  . 
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Figure  1  -  PROPOSED  HIERARCH!  OP  DOCOIEITATIOK 
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First,  the  decision  taker  who  uses  the  sodel  as  an  aid 
to  his  judgeaent  requires  a  non- technical  description  of  the 
sodel.  Non- technical  not  because  the  decision  aaker  cannot 
cosprehend  the  technical  details  but  because  the  exigencies 
of  the  organization  preclude  his  froa  devoting  the  necessary 
tiae  and  effort.  Second,  the  analyst  that  exercises  the 
aodel,  prepares  the  analysis,  and  assists  the  decision  aaker 
requires  a  technical  description  of  the  aodel.  This  enables 
the  analyst  to  know  how  the  aodel  functions  and  explain  and 
interpret  the  outputs  of  the  aodel.  Third,  the  prograaaer 
needs  detailed  docuaentation  that  explains  the  aechanics  of 
the  prograa.  This  docuaentation  provides  the  aeans  to 
troubleshoot  probleas  encountered  luring  routine  running  of 
the  aodel  and  iapleaent  future  aodxf ications.  The  levels 
of  activity  and  their  required  docuaentation  are  shown  at 
Pig  2. 

F.  0ECISI3X  MAKER'S  S OX-TSC  HHTCAL  3  JC USE STATION 

A  non-technical  reference  annual  for  use  by  decision 
aakers  should  provide  sufficient  inforaation  to  deteraine 
general  applicability  of  the  aodel.  It  should  include  a 
general  description  of  how  the  aodel  operates  and  the  aajor 
coaponents,  the  specific  purpose  for  which  the  aodel  was 
originally  designed  and  the  known  liaitations  should  be 
stated.  This  will  allow  the  decision  aaker  to  assertain  the 
overall  ability  of  this  particular  aodel  to  assist  hia  in 
the  problae  at  hand.  The  annual  should  describe  the  data 
reguireaenta,  available  outputs,  and  any  options  provided  by 
the  aodel.  This  facilitates  the  initial  planning  process 
Decause  it  provides  a  basis  for  estlaating  the  expected  tiae 
to  gather  the  input  data  and  what  to  expect  in  the  fora  of 
outputs.  Physical  liaitations,  such  as  coaputars  for  which 
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usable  versions  of  the  sodsl  are  available,  the  progressing 
language  used,  and  typical  running  tises  for  the  aodel,  ere 
necessary  contents  of  the  non-technical  annual.  The  tine  of 
such  senior  aanagers  is  lisited  and  valuable.  Only  that 
inforsation  necessary  to  provide  a  general  description  and 
basis  for  aeaningful  discussions  between  the  decision  aaker 
and  the  analyst  should  be  include!.  Any  details  required 
will  be  provided  by  the  analyst,  who  will  conduct  the  study, 
during  planning,  progress,  and  review  sessions.  Tet  the 
docuaentation  aust  aake  the  aodel  sufficiently  transparent 
so  that  the  decision  aaker  understands  what  is  happening  and 
finds  the  aodel  credible  for  the  proolea  at  hand. 


G.  ANALYST ' S  CONCEPTUAL-TECHNICAL  DOCQHENTATION 


The  analyst's  conceptual-technical  reference  aanual  aust 
necessarily  contain  detailed  inforaation  on  all  aspects  of 
the  aodel.  This  is  the  docuaent  that  dettraines  the 

overall  worth  of  the  aodel  as  an  analytical  tool.  If 
sufficient  detail  is  contained  then  the  analyst  can  becoae 
intiaately  faailiar  with  the  aodel,  so  that  any  aberation 
encountered  during  operation  of  the  aodel  can  be  understood 
his  and  explained  to  the  decision  aaker.  To  aaxiaize  its 
value  to  an  analyst,  it  should  be  written  by  the  analyst  or 
analysts  that  design  the  aodel.  Their  professional 
experience  will  guide  thea  in  providing  the  kind  of 
inforsation  aboat  the  aodel  that  they  would  want  if  they 
were  using  a  aodel  designed  by  soaeone  else. 

The  size  of  the  analyst's  reference  aanual  will  be  a 
function  of  the  coaplexity  of  the  aodel.  To  be  useful  and 
credible  a  aodel  aust  be  transparent  and  transferable.  To 
be  transparent  and  transferable  all  necessary  details  of  the 
aodel  sust  be  provided.  Inforaation  on  the  data  base  used 
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in  the  model.  Input  requirements  and  format  as  well  as 
output  format  and  options  must  be  detailed.  All  that  can  be 
assumed  is  that  the  analyst  is  knowledgeable  in  the  use  of 
the  tools  of  his  profession.  In  preparing  tha  analyst's 
manual  no  prior  knowlelge  of  the  model  can  be  assumed.  As 
Sorris  £2]  recommended,  the  obvious  should  be  written  down. 
All  constraints  and  limitations  must  be  described  in  detail 
as  well  as  assumptions  used,  logic  flow  and 
interactions.  Sufficient  technical  detail  to  allow  the 
analyst  to  annually  trace  inputs  through  the  algorithms  is 
necessary.  Sathematical ,  statistical,  ini  numerical 

methods  incorporated  in  the  model  should  be  described 
including  any  new  or  unique  applications.  Any  constraints 
which  will  affect  the  accuracy  of  the  model  must  be 
identified.  Obvious  pitfalls  must  be  stated;  they  are  only 
obvious  to  the  developer  and  in  complex  models  without 
documentation  they  can  even  be  forgotten  by  the 

developer.  The  physical  processes  simulated  must  be 

described  including  an  explanation  and  rationalization  of 
the  techniques  used.  Bach  variable  and  the  entity  it 
represents  must  be  clearly  stated.  Lastly,  sufficient 
instructions  describing  how  to  set  up  and  use  the  model  and 
flow  charts  keyed  to  the  program  instructions  should  be 
provided.  Zgually  important  is  a  system  that  keys  the 
description  of  each  mathematical  formulation  in  the  manual 
to  the  appropriate  section  and  lines  of  the  program 

code.  This  will  facilitate  the  location  of  tha  code,  when 
the  analyst  wants  to  modify  the  model. 

These  are  the  basic  requirements  for  the  contents  of 
documents  to  be  prepared  by  the  designer  of  a  model.  Bach 
time  a  modification  to  the  model  is  made,  the  changed 
program  Instruction,  reasons  why  the  change  was  necessary, 
how  and  what  is  affected  in  the  model,  and  the 
rationalization  for  the  particular  modification  should  be 
documented  and  incorporated  into  the  original 
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docuaentation.  This  aspect  of  documentation  is  critical 
because  analyst  and  prograaners  nave  bean  known  to  naka 
saall  insignificant  changes  to  prograas  without  docuaanting 
thaa.  Two  rasults  can  coaa  about  bacausa  of  this.  Ovar 
tiaa  thasa  ainor  undocuaentad  changas  accuaulate,  than  ona 
day  thosa  who  iaplanentad  the  changas  transfar  or  dapart. 
The  newly  arrived  analyst  now  has  a  aodal  which  does  not 
quite  fit  his  docuaenta  tion.  If  enough  tiaa  has  passed 
even  thosa  who  aada  the  change  will  not  coapletely  raaaaber 
it  when  they  are  questioned  or  they  are  no  longer 
availaole.  Even  aore  disheartening  is  that  in  failing  to 
docuaent,  a  critical  inspection  of  the  effect  of  the  change 
on  other  parts  of  the  aodel  is  not  aade.  Unbeknownst  to  the 
individual  the  aodification  causes  an  effect  elsewhere  in 
the  aodel  that  is  not  readily  discarnable  at  the 
tiae.  Utiaately,  another  aodification  is  aade  and  the  aodal 
aalfunctions  or  an  anoaalous  output  occurs.  If  undocuaentad 
aodif ica tioas  have  been  aade  and  forgotten  it  nay  be 
iapossibla  to  trace  the  cause  of  the  anoaaly.  If  it  can  be 
traced,  the  cost  of  trouble  shooting  and  correcting  the 
aodel  will  be  greater  than  the  cost  of  docuaenting  the 
aodif ica tions  at  the  tise  of  their  addition.  Current 
studies  will  be  delayed  with  their  attendant  costs  and  the 
credibility  of  the  aodeling  coaaunity  will  suffer.  The 
decision  aakar  justifiably  becoaas  skeptical  when  the 
analyst  cannot  explain  why  the  results  of  a  aodal  are  not 
coapatibla  with  the  decision  aaker*s  intuitive 

expectations.  If  a  aodel  is  to  aid  in  the  decision  asking 
process  its  outputs  aust  be  explainable  and  understandable 
to  the  decision  aakar.  If  the  analyst  has  not  designed  the 
aodel  then  hia  only  source  of  the  necessary  infocaation  is 
the  docuaentation  supplied  with  the  aodel. 
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H.  PaOGHAaflEH'S  TECHNICAL  OOCO DENTATION 


The  final  level  of  requited  documentation  is  the 
detailed  information  required  by  the  programmer  for  the 
operation  and  aaintenance  of  the  aodel.  This  is  the 
docuaentation  that  is  discussed  in  great  detail  in  all 
standard  texts,  while  aethods  of  docuaenting  the  conceptual 
basis  of  models  is  almost  entirely  foregone.  The  aanual  is 
necessarily  prepared  by  the  aodel  prograaaer  in  conjunction 
with  the  analyst  who  has  designed  the  aodel.  It  aust 
contain  descriptions  of  each  global  satiable  and  in  which 
subprograas  the  variable  is  found.  Descriptions  of  the 
functions  perforaed  by  the  program,  data  flow  charts, 
function  flow  charts,  approxiaatxons  and  nuaerical 
procedures  used  are  also  contained  in  this 
docuaentation.  Likewise,  any  iaplicit  assuaptions  aade  by 
the  prograaaer  during  the  coding  process  to  facilitate 
computation  aust  be  documented. 

Often,  though  the  analyst  designer  has  structured  the 
aodel  to  handle  the  general  case,  during  implementation  of 
the  aodel  on  the  coaputer  soae  loss  of  generalization 
occurs.  In  the  search  for  prognaaing  efficiency  the 
coaputer  prograaaer  aay  code  a  coabat  process  so  that  the 
aodel  works  for  only  those  circuastance  explicitly  stated  by 
the  designer.  fhereas  the  designer  believes  he  has  a 
general  aodel  the  prograaaer  has  reduced  the  generality  of 
the  aodel.  Unless  this  is  documented  by  the  prograaaer,  in 
subsequent  use  of  the  aodel  the  fact  that  tha  aodel  was 
prograaaed  in  such  a  Banner  aay  be  forgotten.  In  this  case 
the  coaputer  routines  eabody  aore  assuaptions  than  exist  in 
the  foraal  aodel  designed  by  the  analyst.  It  is  incuabent 
upon  the  prograaaer  to  bring  this  fict  to  the  attention  of 
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the  analyst.  He  inturn  lust  include  this  inforaation  in  his 
docusentation.  Duly  he  can  conceptualize  in  teras  of  real 
world  factors  the  iapact  of  the  prograaaer 's  assuaptions  on 
the  inputs  and  outputs. 

Further  contents  of  the  detailed  progressing  annual  aust 
indicate  priaary  and  secondary  storage  requireaents,  error 
detection  and  recovery  procedures,  and  instructions  for 
initiation  and  teraination  of  prograa  operation.  These 
pieces  of  inforaation  are  required  if  other  prograaaers  are 
to  be  aole  to  understand  and  operate  the  aodel.  If  a  aodel 
is  transferred  this  inforaation  is  necessary  to  iapleaent 
the  aodel  on  a  coaputer  of  different  design.  It  provides 
the  receiving  prograaaer  the  necessary  inforaation  to 
prepare  systea  operating  prograas  and  procedures  so  that  the 
aodel  can  be  exercised  by  the  receiving  agency  without 
inadvertently  sating  changes  to  the  logic  of  the 
aodel.  This  is  especially  critical  for  coaplex 
aodels.  With  such  aodels  atteapts  to  restructure  prograas 
to  overcoae  incoapatibilit ies  in  storage  or  other  aachine 
requireaents  aay  introduce  changes  to  the  fundaaental  logic 
of  the  aodel  unbeknownst  to  either  the  prograaaer  or  the 
analyst,  without  adequate  docusentation  such  restructuring 
aust  be  accoaplished  wita  only  luck  to  guide  the  way  and  as 
coaplexity  of  the  aodel  increases  luck  is  quickly 
depleted . 

When  the  original  prograaaer  coapletes  the  progressing 
(coding)  of  the  aodel  the  aodel  aust  be  verified  and 
validated  in  contention  with  the  analyst  designer.  When 
both  are  satisfied  that  the  aodel  is  operating  as  designed  a 
listing  of  the  coapiled  asseabled  prograa  should  be 
aade.  This  is  then  suppleaented  by  a  set  of  working  notes 
on  prograa  operations,  set  up  of  the  deck  to  exercise  the 
aodel,  special  prograaaing  features  and  identification  of 
potential  problea  areas  and  suggested  solutions. 
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The  compilation  of  the  above  docuaentation  into  a 
detailed  programmer's  aanual  Mill  provide  a  sound  basis  for 
revieM  and  analysis  of  the  model's  capabilities  and  for 
aaintenance  of  the  aodel's  logic;  it  vill  facilitate 
transfer  and  insure  transparency.  Furthermore,  each  tine 
the  prograaaer  makes  a  Modification  to  the  prograa  it  aust 
be  docuaented  and  incorporated  into  the  programmer's 
aanual.  Concurrently,  it  aust  be  brought  to  the  attention 
of  the  analyst  to  relate  the  prograaaing  change  to  the 
coabat  process  modeled  and  update  the  analyst's  and  decision 
aaker's  aanual.  This  coordination  oetween  the  prograaaer 
and  the  analyst  aust  always  occur  if  both  are  to  reaain 
fully  cognizant  of  what  as  well  as  how  the  model  siaulates 
the  real  world.  Only  through  such  docuaentation  can  a  aodel 
be  transferred  to  a  new  prograaaer  and  analyst  teas  and  be 
knowledgeably  used. 


I.  INLINE  DOCUAENTATION,  1  HAP  TH HU  THE  HAZE 


A  necessary  adjunct  to  this  proposed  docuaentation 
package  is  docuaentation  within  the  prograa.  Such 
docuaentation  should  be  in  the  fora  of  coaaent  cards  that 
briefly  describe  the  aain  prograa,  the  aajor  sub-aodels, 
suoroutine  and  each  function  subprograa.  They  should  be 
Inserted  at  appropriate  locations  so  that  logic  of  the 
prograa  is  readily  apparent.  Nothing  is  aore  frustrating 
to  an  analyst  that  is  attempting  to  gain  a  guick  basic 
understanding  of  a  aodel  than  a  series  of  calls  to 
subroutines  which  inturn  call  other  subroutines  and  or 
function  subprograms.  In  a  cos pier  aodel  this  guickly  hides 
the  logic  of  the  aodel  froa  the  analyst.  To  pierce  this 
shroud  the  analyst  aust  devote  tiae  that  could  better  be 
used  elsewhere.  If  the  exigencies  of  the  situation  demand  a 
rapid  response  and  no  other  aodel  is  readily  available  this 
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encourages  the  analyst  to  use  the  aodel  as  the  proverbial 
"black  box".  This  neither  adds  to  transparency  nor  does  it 
enhance  the  reputation  of  the  analyst  or  operations 
research . 

Host  current  progrianing  texts  recoaaend  using  coneent 
cards  to  enhance  understanding  of  prograns.  In  conplex 
aodels  this  is  not  a  nicety  but  a  necessity.  Tine  devoted 
to  this  effort  initially  not  only  enhances  the  use  of  a 
conplex  aodel  but  reduces  recurring  costs.  Prof essionalisa 
deaands  that  a  aodel  should  not  be  used  without 
understanding  how  it  functions  or  at  least  believing  one 
understands  how  it  functions.  The  realities  of  ailitary 
personnel  policies  dictate  that  ailitary  analysts  will 
rotate  rapidly  through  assignaents.  If  a  prograa  is  not 
docuaented  internally  this  self-educating  step  occurs  each 
tiae  a  new  analyst  uses  a  particular  aodel.  Given  a  conplex 
aodel  and  noraal  personnel  turnover  a  sizeable  cost  is 
incurred,  with  adequate  internal  docuaentation  this  cost 
will  occur  only  once.  Because  of  personnel  rotation  aodels 
not  currently  having  such  internal  docuaentation  should  have 
it  added.  Though  it  will  detract  an  analyst  for  an 
additional  aaount  of  tiae  initially,  over  the  longer  tera  a 
savings  will  be  realized.  Each  subsequent  analyst  will  not 
have  to  start  froa  scratch  when  trying  to  gain  an 
understanding  of  how  the  aodel  functions;  understanding  will 
be  facilitated  by  internal  docuaentation  via  coaaent  cards. 

J.  UPDATING  A  MODEL'S  DOCUMENTATION 

Changes  to  aodels  occur  over  extended  periods  of  tiae. 
Obviously,  at  the  tiae  changes  are  instituted  the  process 
through  which  they  were  developed,  why  and  how  they  were 
entered  into  the  aodel  and  all  assuaptions  used  aust  be 
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annotated  in  all  appropriate  docuaentation  at  the  agency 
instituting  the  change.  Soae  of  these  changes  will  be 
extreaely  large  and  will  justify  foraal  changes  being 
printed  and  distributed  for  all  affected 
docuaentation.  Soae  changes  will  be  saall;  foraal  printing 
of  individual  changes  would  not  be  justified.  These  would 
have  to  be  accuaulated  and  changes  printed,  when 
econoaically  practical.  The  aanageaent  of  the  process  and 
the  deteraination  of  when  printing  and  distribution  of 
changes  is  econoaically  practical  are  beyond  the  scope  of 
the  thesis.  They  are  iaportant  subjects  and  should  be 
exaained  in  soae  future  thesis. 


k.  saaaiaY 


Since  the  analysts  and  prograaaers  that  develop  a 
particular  aodel  are  not  always  present  or  available  when 
the  aodel  is  exercised,  especially  if  it  is  transferred  to 
another  agency,  it  is  their  responsibility  to  detail  their 
assuaptions,  siap lifications  and  aet hodologias  and  provide 
evidence  that  the  rationale  behind  their  approach  will 
produce  results  usable  in  the  real-world  environaent  as 
viewed  by  the  ultiaate  decision  aaker.  Analysts  and 
prograaaers  that  create  a  aodel  aust  provide  docuaentation 
that  establishes  the  issues  exaained  by  the  aodel, 
underlying  the  objectives  and  assuaptions,  the  usability  and 
usefulness  of  the  aodel.  Only  with  sjcn  docuaentation  can 
the  analyst  or  analysts  assisting  a  decision  aaker  in  the 
resolution  of  a  particular  problea  conclude  that  the  use  of 
a  specific  aodel  is  appropriate.  The  real  "user"  of  a 
aodel  is  the  decision  aaker.  The  analyst  aust  recognize 
in  assisting  the  decision  aaker  he  is  a  aodel  designer  and 
aodel  aanipulator.  The  officer  analyst  aust  gain  detailed 
knowledge  of  any  aodel  he  uses  in  support  of  an  analysis. 
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To  acquire  such  knowledge  a  model  must  be  adequately 
documented.  In  combat  modeling  there  are  three  levels  of 

participation  each  with  unique  documentation  requirements. 
These  levels  are: 

•  Decision-maker  level; 

•  Analyst  level; 

■  Programmer  level. 

To  enhance  the  ability  of  the  analyst  to  fully 
understand  the  aodel  his  documentation  should  oe  presented 
from  the  context  of  discovery  ratner  than  the  traditional 
context  of  justification.  This  will  allow  the  analyst  to 
know  the  alternatives  considered  and  rejected  in  structuring 
a  aodel  as  well  as  giving  him  greater  insights  into  the 

underlying  hypothesis  of  a  aodel. 

The  types  of  documentation  required  are: 

•  Decision  Raker's  Mon-technical  Documentation; 

•  Analyst's  Conceptual-t echnica  1  Documentation; 

•  Programmer's  Technical  Documentation; 

•  Inline  Documentation. 

Since  aodel  modification  and  improvement  is  a  continuing 
process  tae  preparation  of  formal  changes  must  be 

economically  pract^cm  and  carefully  managed.  This  area  of 
aodel  documentation  is  suitable  for  a  subsequent  thesis. 
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A.  SOBHABT  OP  PBOBLEHS  DISCUSSED 


Since  1973  the  iapetus  in  tna  Are/  Modeling  coeeunity 
has  been  to  develop  scenarios  and  aodels  that  can  be  used 
throughout  the  Are/  coeeunity  for  decisions  on  Material 
requireaents  and  force  developaent.  The  ultiaate  purpose  is 
to  bring  consistancy  into  the  decision  asking 
process.  Inherent  in  this  goal  is  not  only  the  need  for 
standard  agreed  upon  scenarios  but  for  a  repertory  of  aodels 
to  be  used  by  all  interested  agencies  exa lining  a  particular 
facet  of  tne  Aray.  This  ioes  not  necessarily  aean  that  only 
one  aodel  should  be  used  for  a  particular 
investigation.  Because  of  the  assuaptions  necessary  to 
develop  any  aodel,  given  the  necessary  tine  and  aoney  it  is 
best  to  exercise  aore  than  one  aodel  in  order  to  get  an 
indication  of  hoe  the  assuaptions  affect  the  outputs  of  each 
of  the  aodels.  Hhat  is  fundaaental  is  the  need  for  all 
agencies  exaaining  a  given  situation  to  be  able  to 
understand  each  other’s  aodels;  this  will  provide  the  basis 
for  intelligent  discussion  of  the  pros  and  cons  of  equipsent 
and  force  requireaents. 

As  operations  research  and  systea  analysis  have  gained 
acceptance  by  DOD  and  Departaent  of  the  Aray,  aore  coabat 
aodels  of  various  levels  of  ailitary  operations  have  been 
created  and  used.  Increased  use  of  aodels  resulted  in 
increased  levels  of  coaplexity.  Coaplexity  in  turn  caused 
new  aodels  to  be  created  when  potential  users  could  not 
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sufficiently  understand  and  use  existing  aodels  given 
available  docuaentation.  This  unnecessary  proliferation 
resulted  in  unexplainable  conflicting  results  which  caused 
the  credibility  of  coabat  modeling  to  be  questioned.  If 
this  situation  is  to  be  resolved  unnecessary  proliferation 
aust  be  checked  and  autual  understanding  enhanced.  To 
achieve  this  goal  aodels  aust  be  easily  transferable  between 
investigating  agencies,  rundaaental  to  this  ability  is 
coaplete  and  up  to  date  docuaentat ion  of  the  aodel  to  be 
reviewed  or  exercised.  This  docu ae ntation  will  allow  the 
potential  user  to  analyze  the  aodel  and  deteraine  its 
suitability  for  a  given  project. 

Conceal  t  ant  with  the  need  to  easily  transfer  aodels  is 
the  need  to  fully  understand  the  aachination  by  which  a 
give*  set  of  input  data  is  acted  upon  to  produce 
outputs.  If  outputs  of  a  coaputer  aodel  are  to  be  useful 
they  aust  oe  credible.  Conflicting  outputs  of  ailitary 
aodels  are  consistently  challenged  by  soae  govecnaent  agency 
of  the  DO D,  the  Congress,  the  Executive  Dffice  or  soae  other 
branch  of  the  governaent.  Unless  these  challenges  are 
answered  and  conflicts  explained,  the  credibility  of  coabat 
aodeling  will  continue  to  suffer.  Soae  criticisa  is  needed 
to  purify  coabat  aodeling  and  identify  errors  that 
inevitably  will  appear,  soae  eainates  froa  those  advocating 
a  coapetitive  aodel  or  concept  and  soae  of  it  is  froa  those 
that  criticize  the  validity  and  usefulness  of  coabat 
aodeling  itself.  *t  tiaes  inadequate  docuaantation  has 
precluded  the  explanation  of  conflicting  results  by  the 
analyst  and  added  to  the  criticisa. 

The  Coaptroller  General  [15J  found  that  existing  aodels 
have  been  used  by  other  than  the  designer  without  thoroughly 
understanding  their  iaplications  and  liaitations.  It  tiaes 
this  has  rasultad  in  erroneous  conclusions  being  drawn  and 
decisions  aade  based  on  these  conclusions.  Subsequently, 
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the  errors  are  surfaced  with  a  loss  aot  only  in  dollars 
expended  in  pursuit  of  undesirable  projects  bat  in  further 
loss  of  credibility  for  theatre-level  cosbat  aodeling. 

Adequate  docusentation  will  help  alleviate  soae  of  the 
adverse  publicity  and  loss  of  credibility  that  theatre-level 
coabat  aodeling  has  experienced  in  the  past.  To  a  great 
extent  this  has  steaeed  froa  unexplainable  contradictory 
results  using  aodels  purporting  to  represent  the  sane 
process.  To  allay  the  criticise  of  aodels  and  their 
outputs  and  to  enable  both  the  analyst  that  exercises  the 
aodel  and  the  decision  saner  that  uses  the  outputs  to  aid  in 
the  decision  sailing  process  the  aodel  aust  be 
understood.  Under  standing  can  be  enhanced  through  proper 
4ocueentation.  Adequate  docusentation  of  the  fora  proposed 
will  facilitate  coasunicat ion  between  the  decision  Baker  and 
analyst  as  well  as  between  the  analyst  and  the 
progcaaaer.  Unless  those  coeaunication  links  are 
established  aisunderstanding  of  coabat  aodels  will  persist 
and  the  credibility  of  coabat  aodels  and  aodeling  will 
suffer  accordingly. 

a.  COICLUSIOIS  AID  aZCORBEHDATIOIS 

The  conclusions  drawn  frca  this  research  art: 

•  The  decision  aaker  is  the  "user"  of  a  aodel. 

•  To  be  of  value  a  aodel  aust  be  accepted  by  the 
decision  aaker. 

•  The  analyst  aust  relate  the  abstractions  of  the 
aodel  to  the  actual  coabat  process. 

■  The  analyst  is  a  aodel  aaaipulator. 

e  The  analyst  aust  understand  and  explain  the 
aethodology  and  structure  of  a  aodel. 

e  Understanding  is  deterred  by  coaplexity. 
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•  aodels  are  becoaing  aore  coupler. 

■  Increased  levels  of  coaplexity  resalt  in 
diainished  transparency. 

•  Inability  to  understand  and  use  existing  aodel 
causes  developaent  of  redundant  aodels. 

•  Unnecessary  proliferation  causes  conflicting 
results  to  be  produced  by  siailar  aodels. 

•  Inability  to  explain  conflicting  results  is  the 
basic  cause  of  a  lack  of  credibility. 

Proliferation  can  be  reduced  through  aodel 
sharing.  Sharing  a  aodel  requires: 

«  ability  to  use  it  with  ainiaal  conversion; 

•  adequate  facilities  to  run  the  aodel; 

•  sufficient  coapetent  analysts  and  prograaaers; 

•  adequate  docuaentaton; 

•  foraalized  lcrangeaents  for  cost  sharing  and 
coordination. 

Prior  to  transferring  a  aodel  it  aust  be  analyzed  for 
applicability  and  appropriateness.  Such  an  analysis  should 
consider : 

•  inputs  and  outputs; 

•  basic  causal  relationships; 

•  aodel  logic  and  structure; 

•  available  data  and  required  data; 

•  tiae  and  resources  required. 

deny  existing  doabat  aodels  are  characterized  by: 

•  subaodel  inadequacy; 

•  key  variables  excluded; 
e  inherent  inaccuracies; 

•  cosputational  difficulties; 

•  inconsistent  assuaptions; 
e  inappropriate  assuaptions; 
a  inadequate  output. 
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The  dagrM  to  which  aeaningful  aodal  evaluation  can  be 
accoaplished  is  significantly  influenced  by  available 
docuaentation.  Do cu sent at  ion  is  key  to  the  understanding 

of  coaplex  aodels.  The  research  conducted  indicated: 

•  Adequate  docuaentation  is  a  necessary  if  a 

aodel  is  to  be  used  by  other  than  the 

originator . 

•  Organization  exigencies  deter  adequate 

docuaentation. 

•  Docuaentation  of  coabat  aodels  is  generally 
inadequate. 

■  If  a  aodel  is  poorly  docuaented  it  aay  be  sore 
econoaical  to  build  a  nan  one  than  share  an 
existing  aodal. 

e  Efforts  are  being  aade  to  iaprove  docuaentation. 

The  author's  experience  with  and  research  of  coabat 
aodel  docuaentation  indicates  that  there  are  three  levels  of 
interaction  vith  coabat  aodels.  These  levels  have  unique 
and  coaacn  requiraaents  for  docuaentation.  To  satisfy  these 
requireaents  the  author  envisions  three  levels  of 

docuaentation: 

•  DECISION  9 IKES' S  NON -TECHN ICA1 

e  ANALYST'S  CONCEPTUAL -TECHN ICAL 

e  PB0GRA99 ES 'S  I ECHNICAL 

The  decision  aaker's  and  the  prograaaer's  docuaentation 
aust  provide  the  inforaation  listed  in  chapter  six.  It  can 
be  presented  in  the  traditional  Banner  using  techniques 
contained  in  aost  coaputer  systea  aanageaent  texts. 

However,  to  function  as  the  link  between  the  decision  saker 
and  the  prograaaer  and  to  understand  the  nuances  of  the 
aodel,  the  analyst  needs  docuaentation  that  provides  greater 
insights  than  possibla  with  the  current  available 

docuaentation.  These  insights  will  be  provided  if  the 
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Analyst* s  docuaent at  ion  is  pcasantsd  froa  ths  context  of 
discovery  rathar  than  the  traditional  context  of 
justification. 

Hany  changes  to  a  nodal  occur  over  extended  periods  of 
tine.  The  aethod  of# detecnining  when  it  is  econoaically 
practical  to  print  forsal  changes,  their  disribution. 


control,  and  aanageaent  is  critical  to  the  proposed 
hierarchy  of  documentation.  These  topics  are  appropriate 
for  future  research. 


C.  PISAI.  3E SAAKS 


Acceptance  or  rejection  of  an  expository  thesis  in 
natters  such  as  docuaentation  often  depends  on  tha  skill  of 
the  pleader  and  the  aood  of  the  audience.  Staring  at  the 
saae  set  of  evidence  the  parties  to  the  debate  can  coee  to 
sharply  different  conclusions,  since  their  preconceived 
notions  aay  lead  thee  to  select  and  interpret  the  evidence 
in  different  ways.  Sven  though  one  aay  initially  find  it 
difficult  to  believe  that  there  are  ways  to  acquire  adequate 
docuaentation  not  yet  tried  by  analysts  or  advocated  by 
agencies  researching  the  problea,  the  very  coaplexity  and 
pervasiveness  of  the  problea  suggests  the  possibility  of 
coabining  the  various  proposals  in  different  ways  so  that 
aoae  coabinatioa  sill  produce  the  desired  goal.  The 
proposal  presented  is  but  one  possible  aeans  to  achieve  the 
desired  end.  Of  even  aore  iaportance  is  the  fact  that  soae 
aethodology  aust  be  adopted  to  correct  this  lack  of  adequate 
docuaentation.  Sith  regard  to  theatre- level  coabat  aodels, 
the  problea  has  persisted  for  alaost  twenty  years,  hot  only 
has  it  aade  it  near  iapossible  to  easily  transfer  aodels 
between  interested  agencies  but  it  has  prevented  ailitary 
analysts  froa  gaining  full  knowledge  of  the  aodels  they 
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Tbs  conflicting  opinions  and  evaluations  unaasked  during 
this  rsssarch  confirs  what  is  intuitively  obvious:  aany  of 
tbs  historical  judgeaents  and  docisions  concsrning 
oporations  rsssarch  in  gsnsral  and  theatre- level  cosbat 
aodeling  in  particular  ars  based  on  subjective  values  as 
well  as  objective  facts.  Onliks  ths  natural  scisntist  or 
ths  analyst  using  a  siaulition,  ths  rsssarchsr  exaaining  ths 
procsss  through  which  cosbat  sodsllng  has  evolved,  cannot 
ropcoducs  ths  events  and  by  exper ias ntally  altering  ths 
ingredients,  change  the  result.  Ths  developaent  of  cosbat 
aodeling  is  well  docuaented;  yet  controversies  have 
developed  despite  ths  voljainous  sources.  Analysts  disagree 
not  because  one  aay  be  sore  knowledgeable  about  the  subject 
than  another,  but  because  each  weighs  and  evaluates 
differently  those  facts  of  which  both  have  knowledge.  There 
is  little  dispute  about  the  details  of  what  has  happened  in 
the  developaent  of  theatre- level  cosbat  aodels  but  there  is 
intense  disagreesent  on  the  significance  of  past  events  and 
how  to  proceed  in  the  future.  The  analyst  has  no  fixed 
point  froa  which  to  observe  the  stress  of  events  concerning 
the  developaent  of  theatre- level  cosbat  aodels.  Analysts 
are  borne  along  by  the  current  and  their  interpretation  of 
what  has  occurred  is  influenced  by  their  view  of  where  the 
stress  seeas  to  be  headed  and  whether  the  apparent 
destination  appears  to  be  good  or  bad  for  the  enhanceaent 
and  developaent  of  the  OB  profession. 

Although  theatre-level  cosbat  aodeling  atteapts  to  be 
scientific  in  its  aethods,  it  is  rarely  so  in  its 
outputs.  Outputs  are  interwoven  with  subjective  judgesents, 
either  through  their  interpretation  or  by  way  of  the  inputs 
that  were  instruaental  to  producing  the  outputs  or  in  the 
very  construction  of  the  aodel  itself.  The  relativity  of 
subjective  judgeaent,  while  discouraging,  need  not  be 
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debilitating  to  theatre- level  coabat  aodeling.  Because 
these  aodels  are  the  only  aeans  of  exaaining  force  structure 
guest  ions  vital  to  national  security,  analysts  are 
confronted  with  the  continuing  task  of  rethinking  the  basic 
structures  of  these  aodels.  Past  aodels  can  furnish  us  a 
vast  reservoir  of  experience  in  theatre- level  coabat 
aodeling  vhich  can  be  exploited  to  further  this  aspect  of 
operations  research,  aowever,  this  reservoir  can  be 
effectively  used  for  the  enhanceaent  of  the  profession  only 
if  vhat  has  been  accoaplished  is  adequately  docuaented  so 
that  others  aay  correctly  use  aodels  previously 
developed.  In  this  aanner,  even  though  no  aodel  can  fully 
treat  all  the  intricacies  of  the  coabat  process,  the  analyst 
can  enrich  the  profession  through  the  continuing  effort  to 
better  aodel  the  process  fully  using  all  the  knowledge  that 
has  coae  before. 

The  concept  of  docuaentation  that  this  paper  proposes 
will  not  cure  ail  the  ills.  It  is  but  a  proposal  to  correct 
a  defect,  inadequate  docuaentation,  that  has  long  plaqued 
theatre- level  coabat  aodeling.  But  if  it  is  faithfully 
executed  with  the  saae  energy  and  level  of  effort  that  has 
been  expended  in  decrying  the  problea  of  inadequate 
docuaentation,  then  there  is  hope  that  the  oalssion  can  be 
corrected.  It  is  isperative  that  analysts  adequately 
docuaent  newly  designed  aodels  or  sodif ications  to  existing 
aodels  so  that  other  analysts  aay  use  thea  properly.  Before 
a  project  ia  considered  couplets  it  is  the  analyst* s 
responsibility  to  insare  that  the  vital  step  of 
docuaentation  is  accoaplished.  Only  in  this  aanner  can 
there  be  assurance  that  the  aodel  designed  or  aodified  can 
be  fully  understood  by  those  who  subsequently  want  to  use 
the  aodel.  analysts  using  existing  aodels  anst  expand  and 
suppleaent  the  current  available  docuaentation  of  existing 
aodels  in  the  active  inventory.  The  next  tiae  an  existing 
aodel  is  used  professionalise  deaands  it  be  fully 


understood;  any  new  uadocuaented  factors  uncovered  in  its 
examination  should  be  foreally  noted  and  nade  a  permanent 
part  of  the  official  docuaentation.  In  this  Banner  past 
oaissions  will  be  corrected,  the  scientific  aethod  will  be 
invigorated  and  the  standing  of  the  Operations  Research 
profession  enhanced,  subsequent  results  will  then  be  aor* 
fully  explainable  and  posses  greater  credibility  and  even  if 
the  conclusions  cannot  be  final,  because  of  the  impalpable 
nature  of  the  subject,  the  techniques  of  theatre-level 
coabat  aodeling  will  be  enriched  by  the  process. 
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